-- Logs begin at Thu 2022-08-18 18:07:12 UTC, end at Thu 2022-08-18 19:39:46 UTC. -- Aug 18 19:12:35.562853 dv-osbrick-852610-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 19:12:35.570388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 19:12:35 2022] *** Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: nodename: dv-osbrick-852610-2-ceph Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: machine: x86_64 Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: clock source: unix Aug 18 19:12:35.572388 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: pcre jit disabled Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: detected number of CPU cores: 4 Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: current working directory: / Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: detected binary path: /usr/bin/uwsgi-core Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: your processes number limit is 47680 Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: your memory page size is 4096 bytes Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: detected max file descriptor number: 2048 Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: lock engine: pthread robust mutexes Aug 18 19:12:35.572870 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: thunder lock: enabled Aug 18 19:12:35.573867 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 19:12:35.574005 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 19:12:35.619181 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: Python main interpreter initialized at 0x5653488229c0 Aug 18 19:12:35.619181 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: python threads support enabled Aug 18 19:12:35.619181 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: your server socket listen backlog is limited to 100 connections Aug 18 19:12:35.619181 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: your mercy for graceful operations on workers is 90 seconds Aug 18 19:12:35.619538 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 19:12:35.619614 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: *** Operational MODE: preforking *** Aug 18 19:12:35.619865 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: *** uWSGI is running in multiple interpreter mode *** Aug 18 19:12:35.619865 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: spawned uWSGI master process (pid: 88210) Aug 18 19:12:35.620076 dv-osbrick-852610-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 18 19:12:35.620629 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: spawned uWSGI worker 1 (pid: 88222, cores: 1) Aug 18 19:12:35.620984 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: spawned uWSGI worker 2 (pid: 88223, cores: 1) Aug 18 19:12:35.621139 dv-osbrick-852610-2-ceph devstack@keystone.service[88210]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 19:12:40.240835 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:12:40.240835 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: from cryptography.utils import int_from_bytes Aug 18 19:12:40.241657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:12:40.241657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: from cryptography.utils import int_from_bytes Aug 18 19:12:40.245787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:12:40.245787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: from cryptography.utils import int_from_bytes Aug 18 19:12:40.246254 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:12:40.246254 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: from cryptography.utils import int_from_bytes Aug 18 19:12:40.292014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 19:12:40.292198 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 19:12:40.292394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] command line args: [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 19:12:40.292668 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 19:12:40.292879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ================================================================================ {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 19:12:40.293135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] admin_token = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.293382 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] config_dir = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.293467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 19:12:40.293554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.293640 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 19:12:40.293763 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] config_source = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.293900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] command line args: [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 19:12:40.293984 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] debug = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.294105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 19:12:40.294193 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.294409 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ================================================================================ {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 19:12:40.294409 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] admin_token = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.294601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.294708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.294816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] config_dir = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.294816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295003 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295099 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] config_source = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] debug = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295541 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295670 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_config_append = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.295991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296095 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_dir = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296192 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296301 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_file = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296548 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296667 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_config_append = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.296980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297099 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297099 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_dir = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297375 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_file = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297674 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297833 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.297957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298034 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298466 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298666 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.298956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299032 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299720 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.299890 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] publish_errors = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300304 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300548 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.300938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] publish_errors = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301381 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] standard_threads = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.301916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302100 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302204 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] use_journal = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] use_json = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] use_stderr = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302628 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] standard_threads = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] use_syslog = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.302959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303252 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.303350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] use_journal = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.303527 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] use_json = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303686 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] use_stderr = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303770 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.303843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] use_syslog = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.303941 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.304077 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:12:40.304194 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.304897 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305384 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305874 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.305943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306111 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306516 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306649 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.306906 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307072 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307553 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307638 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.307876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308029 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308507 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.308851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309104 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309304 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309401 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309752 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.309986 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310455 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310705 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.310937 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311473 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311703 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.311957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.312906 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313140 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313529 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313609 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313756 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313834 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.313985 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314139 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314293 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314432 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.314971 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315355 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315593 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315674 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.315896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316053 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316283 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316516 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316600 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316770 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.316867 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317006 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317236 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317313 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317464 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317555 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.317932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318621 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.318961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319334 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.319819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.320521 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.320610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.320699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.320880 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321008 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321107 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321690 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.321938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322319 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322397 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322552 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322638 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322785 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.322872 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323561 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.323957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324089 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324374 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324506 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324642 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324891 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.324965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325078 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325159 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325324 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325418 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.325882 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326038 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326194 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326282 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326356 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326727 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326818 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.326960 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327053 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327734 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327884 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.327965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328193 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.328941 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329092 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.external = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329592 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329679 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329831 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.329903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330060 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.external = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.password = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] auth.token = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330532 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.330857 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.password = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331246 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] auth.token = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331481 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331797 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.331945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332254 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332500 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332814 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.332913 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333362 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333444 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333608 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.333931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334102 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334558 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334862 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.334942 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335194 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335904 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.335995 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336465 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336623 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336728 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336905 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.336997 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337139 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337379 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337616 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337861 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.337941 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338092 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338181 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338564 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338810 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.338890 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339044 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339382 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339523 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339603 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.339841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340051 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340262 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340519 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340519 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340763 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340852 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.340929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341175 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341406 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341869 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.341950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342114 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342204 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342423 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.342859 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343142 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343271 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.343928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344188 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344569 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.344869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345381 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345511 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.345895 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346430 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.346970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347100 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347483 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.347877 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348140 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348271 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348831 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.348960 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.349341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.349474 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.349613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.349742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.349870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.349998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350125 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350262 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350539 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350758 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.350928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.351886 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352413 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352720 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352856 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.352984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353242 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353766 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.353896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354161 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354556 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354684 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.354939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355205 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355339 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.355862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356257 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356519 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356878 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.356952 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357476 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357548 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357628 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357703 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357777 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357849 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357921 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.357993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358074 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358293 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358437 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358593 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358666 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358811 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.358967 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359042 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359411 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.359933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360006 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360079 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360151 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360526 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.360977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361057 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361552 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361694 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.361929 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] role.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] role.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362461 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362542 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362617 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] role.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] role.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.362946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363065 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363146 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363316 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363649 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363813 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.363895 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364137 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364303 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364533 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.364883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365052 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365136 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365282 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365363 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365610 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.365929 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.366011 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.366169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.366250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.366423 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.366637 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.366719 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.367387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.367468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.367639 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.367720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.367889 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.367970 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368135 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368382 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368615 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.368950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369106 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.369891 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370279 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370521 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370609 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370753 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.370986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371065 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371311 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371532 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.371918 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372008 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372247 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372792 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.372921 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373003 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373249 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373737 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.373983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374128 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374457 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374602 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.374931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.connection = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375558 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375848 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.375933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.connection = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376304 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376376 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376539 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376623 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.376879 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377121 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377605 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377689 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.377904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.378068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.378151 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.378306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.378489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.378619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.378779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379021 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379101 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.379925 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 19:12:40.380057 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.380209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.380477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.380902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.381173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.381454 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:12:40.381697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 19:12:40.409792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.410023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.410265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.410355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.410510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.410736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.419346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.420760 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.447474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.447712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.450357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.450588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.502091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.504853 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.551106 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.551339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.551581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.551816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.619550 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.619777 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.619870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620011 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620328 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620537 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620668 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620793 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.620914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.643550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.643705 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.643790 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.643883 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.643998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644225 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644308 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644450 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644535 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644662 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.644988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.656081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.656233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.669195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.669426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.669567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.669655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.669803 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.669889 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670033 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670119 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670259 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670343 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670692 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.670908 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:12:40.687758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.687968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:12:40.688315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.688519 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:12:40.688703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.688825 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.688909 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:12:40.689093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.689241 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.689357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.689440 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:12:40.689620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.689711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.689955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.690215 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.690472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.699158 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.699443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.699720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.699992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.700077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.700270 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.700542 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.700864 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.706972 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.707764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.709921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.710211 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.710515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.710708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.710799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.710998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711285 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711381 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.711928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712381 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712467 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712783 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.712951 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.713225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.713495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.736041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.737541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.737830 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.738420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.739892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.740177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.742963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.743248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.745163 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.745318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.745606 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.745890 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.751544 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.751830 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.752430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.752675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.755827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.756118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.756407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.756833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.756952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.757117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.757375 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.757480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.757696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.757768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.757976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.758146 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.758513 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.759049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.759438 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.759837 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.774257 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.774543 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.777482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.777771 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.778471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.781628 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.781740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.782043 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.784801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.785104 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.786296 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.790075 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.790189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.793192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.793505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.793589 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.793804 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.794204 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.794500 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.794795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.796618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.796944 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.797233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.797521 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.797803 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.798200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.810633 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.810926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.811199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.811467 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.814012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.814304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.814574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.814850 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.818245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.819926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.820209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.821631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.822907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.823198 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.823315 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.823501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.823587 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.823790 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.824081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.826235 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.826521 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.826829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.827112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.827393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.836030 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.836330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.836618 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.836930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.837217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.837508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.837787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.839121 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.839417 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.839701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.839984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.840268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.840544 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.840856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.854006 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.856953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.857047 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.859962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.860061 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.861425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.862898 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.863013 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.863194 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.863497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.864441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.865956 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.866244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.866532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.870034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.871509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.873015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.874450 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.874536 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.874747 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.875049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.875344 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.877358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.877653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.877937 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.878231 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.883319 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.883615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.883907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.887101 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.887387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.887670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.890708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.891982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.892272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.892556 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.892867 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.893148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.893432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.894001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.894287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.894458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:12:40.894553 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.894816 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.894898 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.895090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.895174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.895364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.895449 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.895653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.895930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.896222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.896494 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.896797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.897087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.897361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.897626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.897905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.898683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:12:40.929327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653488229c0 pid: 88223 (default app) Aug 18 19:12:40.931845 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653488229c0 pid: 88222 (default app) Aug 18 19:12:40.932761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8680a-3dc2-469a-ac48-e327537f5654 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:40.933062 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8680a-3dc2-469a-ac48-e327537f5654 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:40.933340 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8680a-3dc2-469a-ac48-e327537f5654 None None] PATH_INFO: `/v3` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:40.937523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Thu Aug 18 19:12:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:12:48.071929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:48.072427 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:48.072427 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:48.077186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:48.082445 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:48.082858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:48.082992 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:48.159097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: INFO dbcounter [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] Registered counter for database keystone Aug 18 19:12:48.178175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 19:12:48.185052 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writer thread running {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 19:12:48.362595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG passlib.handlers.bcrypt [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88223) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 19:12:48.363023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG passlib.handlers.bcrypt [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88223) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 19:12:48.417877 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:48.419474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:48.549619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 19:12:49.073725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:49.150635 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: INFO dbcounter [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] Registered counter for database keystone Aug 18 19:12:49.172476 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG oslo_db.sqlalchemy.engines [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 19:12:49.179450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writer thread running {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 19:12:49.305269 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84de7b-222c-473a-9fd9-5f519bc87fd1 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:49.309577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:49.310201 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:49.310479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:49.310748 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:49.319818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:49.375486 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING keystone.common.rbac_enforcer.enforcer [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 19:12:49.375825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c99eef-94f0-438f-8606-216e4f56b737 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:49.386728 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Aug 18 19:12:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 19:12:49.392870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:49.407914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf30d64-9f3c-4389-97ff-492b5dc0ed9d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:49.412708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:49.414417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:49.414704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:49.414988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] PATH_INFO: `/v3/projects/8b376485ea1c4cabaaa338eee652b199` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:49.418893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b376485ea1c4cabaaa338eee652b199)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:49.479674 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 19:12:49.480019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5601d2-4997-4518-8e11-c8b67fc3a8d8 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:49.484744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Thu Aug 18 19:12:49 2022] GET /identity/v3/projects/8b376485ea1c4cabaaa338eee652b199 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:12:51.685773 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f684-3471-43c9-8386-b2ec77ab90a8 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:51.686354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f684-3471-43c9-8386-b2ec77ab90a8 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:51.686354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f684-3471-43c9-8386-b2ec77ab90a8 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:51.690406 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:51.696380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:51.696925 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:51.697018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:51.717938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:51.719506 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:51.728522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 19:12:52.053806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f684-3471-43c9-8386-b2ec77ab90a8 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:52.066489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f684-3471-43c9-8386-b2ec77ab90a8 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:52.071353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eb125-b8fd-4e45-9ff8-0c882a684fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:52.071973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb125-b8fd-4e45-9ff8-0c882a684fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:52.072260 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb125-b8fd-4e45-9ff8-0c882a684fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:52.072537 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb125-b8fd-4e45-9ff8-0c882a684fe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:52.081499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb125-b8fd-4e45-9ff8-0c882a684fe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:52.083304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb125-b8fd-4e45-9ff8-0c882a684fe6 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:52.093291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Aug 18 19:12:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 19:12:52.099246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:52.109563 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c077b-5242-447a-9a3b-b28fe0afa398 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:52.113976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c299-4861-4f7a-88f3-c515d47fe7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:52.114613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c299-4861-4f7a-88f3-c515d47fe7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:52.114892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c299-4861-4f7a-88f3-c515d47fe7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:52.115183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c299-4861-4f7a-88f3-c515d47fe7e8 admin admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:52.116523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c299-4861-4f7a-88f3-c515d47fe7e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:52.118424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c299-4861-4f7a-88f3-c515d47fe7e8 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:52.120004 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Thu Aug 18 19:12:52 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:12:54.365769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ce5ab-6238-44ff-b43b-7cf88fb2c360 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:54.366320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ce5ab-6238-44ff-b43b-7cf88fb2c360 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:54.366320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ce5ab-6238-44ff-b43b-7cf88fb2c360 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:54.367681 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:54.373321 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:54.373765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:54.373861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:54.394926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:54.396146 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:54.412823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066058a-d253-49f3-8260-5d8d9c006127 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:54.413113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066058a-d253-49f3-8260-5d8d9c006127 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:54.413920 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066058a-d253-49f3-8260-5d8d9c006127 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:54.415234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:12:54.420232 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:54.420504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:54.420814 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:54.463936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG passlib.handlers.bcrypt [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88222) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 19:12:54.464354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG passlib.handlers.bcrypt [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88222) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 19:12:54.481047 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:12:54.510796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:54.512429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:54.614770 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:12:54.807056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:54.940001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:54.942862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.022372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eb97f-f389-470a-8f08-dcf41b4b5bcb None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.047195 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1d048-40f0-4d58-8cb7-1ca2e8749655 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.049806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:55.056109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.056807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.057152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.057377 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.068584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:12:55.077970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:12:55.079063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:12:55.080102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:12:55.087100 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.087314 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.087973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.088258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.088532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.160979 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.162520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.171005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:55.191622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f51dba-97f2-4778-833b-14ad60f51790 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.232167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.232916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.233208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.233479 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.234164 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:12:55.234467 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.235867 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.248479 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:12:55.254368 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.268492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:12:55.274864 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.278518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:55.363893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad584e6-cc83-411e-9459-ea35d2aef75d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.386561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275083e4-a47c-460a-87a2-ca560d6b0cc3 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.402418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.403594 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.403872 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.404143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.405308 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.406757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.408303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:12:55 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:12:55.413743 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.421081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.421941 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.422222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.422500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.428202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:55.442529 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.443997 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.522289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ad55c-3a3b-44d1-8c8d-60914eaebc41 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.560964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.561614 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.561896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.562171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.563343 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.564831 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.566399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:12:55.572031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:12:55.573007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:12:55.573835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:12:55.573835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:12:55.573835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:12:55.574087 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.574160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:12:55.580181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:55.639098 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:55.656114 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:55.676011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e9df-300d-4a54-b34f-397357e9463d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.683149 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9190d9-9c94-4b62-8e26-159ce1295b29 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:55.710019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.710656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.710936 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.711206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.711962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.domain.id=default, user.id=661b53358e904910bb42d525c798f725) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:12:55.712263 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.713745 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135e50-6b73-40f3-b943-f70220119b49 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.717181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:55.717796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:55.718078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:55.718356 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:55.719004 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:12:55.719310 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:55.720411 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Aug 18 19:12:55 2022] GET /identity/v3/role_assignments?user.id=661b53358e904910bb42d525c798f725&scope.domain.id=default&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:12:55.720702 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43e56-27e1-40e0-8399-f64539b3ab72 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:55.740210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:12:58.583583 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae6f9-60af-4cf7-9809-b2a005216cc2 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:58.584207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9635-6412-4d6c-a4eb-a953e80888b0 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:58.584545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae6f9-60af-4cf7-9809-b2a005216cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:58.584545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae6f9-60af-4cf7-9809-b2a005216cc2 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:58.584722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9635-6412-4d6c-a4eb-a953e80888b0 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:58.584722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9635-6412-4d6c-a4eb-a953e80888b0 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:58.586396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:58.591291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 11/23] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:58.592505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50308-0620-4341-af69-cfb88a711fd4 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:58.593028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50308-0620-4341-af69-cfb88a711fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:58.593563 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50308-0620-4341-af69-cfb88a711fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:58.599285 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8057a-db81-45a8-a8be-8fa2b9096aa4 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:58.599838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8057a-db81-45a8-a8be-8fa2b9096aa4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:58.600118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8057a-db81-45a8-a8be-8fa2b9096aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:58.629322 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-bec8057a-db81-45a8-a8be-8fa2b9096aa4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:58.633696 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-bec8057a-db81-45a8-a8be-8fa2b9096aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:58.635010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-65c50308-0620-4341-af69-cfb88a711fd4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:58.636451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-65c50308-0620-4341-af69-cfb88a711fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:58.783529 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:12:58.835967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:12:58.865902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea48d3-008f-4f61-ae92-fd42d60d05a3 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:58.866213 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea48d3-008f-4f61-ae92-fd42d60d05a3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:58.866759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea48d3-008f-4f61-ae92-fd42d60d05a3 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:58.868254 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 13/26] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:58.874264 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a565-d4a5-4e58-8f7b-aa4d64050c31 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:58.874602 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a565-d4a5-4e58-8f7b-aa4d64050c31 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:58.878183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a565-d4a5-4e58-8f7b-aa4d64050c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:58.899255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ece3a565-d4a5-4e58-8f7b-aa4d64050c31 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:58.905052 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ece3a565-d4a5-4e58-8f7b-aa4d64050c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:59.008624 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 14/27] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:12:59.188559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea48d3-008f-4f61-ae92-fd42d60d05a3 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:59.191780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5112f2-8728-424d-8ef9-88e1079292f8 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:59.192342 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5112f2-8728-424d-8ef9-88e1079292f8 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:59.192871 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5112f2-8728-424d-8ef9-88e1079292f8 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:59.195230 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 15/28] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:12:59.200993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:59.201562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:59.202054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:59.213759 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:59.230881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:12:59.232125 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:12:59.289051 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:59.391551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea48d3-008f-4f61-ae92-fd42d60d05a3 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:59.402980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 16/29] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:12:59.403845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:59.520603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:59.521228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:59.521508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:59.521778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:59.548742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60b1f-d240-4167-b072-9ffa9eed1cae None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:59.557348 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:12:59.564388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:12:59.565296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:12:59.566068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:12:59.568525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 14/30] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:12:59.570602 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:59.597430 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:59.599212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:59.600193 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:59.601198 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:59.602103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:59.603727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:59.615702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:59.782806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb664-b69b-49bd-b1f3-18be86db4b70 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:12:59.801057 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:12:59.825771 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 17/31] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 18 19:12:59 2022] POST /identity/v3/roles => generated 219 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:12:59.831758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:12:59.881834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:12:59.883785 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:12:59.884073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:12:59.884351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:12:59.911064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:12:59.912588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:12:59.943302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:12:59.944289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:12:59.945184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:12:59.945184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:12:59.945184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:12:59.945184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 15/32] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:12:59.947972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:00.019271 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850d3be-2155-47e9-8bf1-d025463221a4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.080013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.081281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.081784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.082384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.084258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:00.084931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.087445 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.100470 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 18/33] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:00.104183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:00.151022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced90e2-f544-4f3a-ad80-1b0e3df931c8 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.195838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84f5e0-a7d8-4a6c-99d4-f7dd7eb7d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.196747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f5e0-a7d8-4a6c-99d4-f7dd7eb7d7e2 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.197172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f5e0-a7d8-4a6c-99d4-f7dd7eb7d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.197625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f5e0-a7d8-4a6c-99d4-f7dd7eb7d7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.198473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84f5e0-a7d8-4a6c-99d4-f7dd7eb7d7e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.200050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84f5e0-a7d8-4a6c-99d4-f7dd7eb7d7e2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.221101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:00.243024 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955eecd-1a60-41e8-b48e-377314e8bd36 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.285480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.286200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.286481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.286766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.287422 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:00.287732 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.289206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.314511 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 19/34] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:00.314511 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:00.342911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 16/35] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 18 19:12:59 2022] POST /identity/v3/roles => generated 225 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:00.344574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9dc1-2bfe-4498-b0a9-9128c0094711 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.344903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9dc1-2bfe-4498-b0a9-9128c0094711 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.345184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9dc1-2bfe-4498-b0a9-9128c0094711 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.346413 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 17/36] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:00.347128 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9dc1-2bfe-4498-b0a9-9128c0094711 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:00.369688 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:00.456077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3a79-667d-42d5-8aab-79a1d4f9890a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.470730 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9dc1-2bfe-4498-b0a9-9128c0094711 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.477806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:00.499524 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6fb9d-8b94-48d7-8418-94e9728f2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.500188 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6fb9d-8b94-48d7-8418-94e9728f2638 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.500475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6fb9d-8b94-48d7-8418-94e9728f2638 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.500796 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6fb9d-8b94-48d7-8418-94e9728f2638 None admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.502231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6fb9d-8b94-48d7-8418-94e9728f2638 None admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.503730 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6fb9d-8b94-48d7-8418-94e9728f2638 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.505732 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 20/37] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:00 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:00.510866 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5424-f696-4285-8385-46a2739215f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.511441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5424-f696-4285-8385-46a2739215f7 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.511727 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5424-f696-4285-8385-46a2739215f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.512003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5424-f696-4285-8385-46a2739215f7 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.512097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610fc8b-03c4-4b58-a98d-f849a19f2bfd None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.512291 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610fc8b-03c4-4b58-a98d-f849a19f2bfd None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.512572 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610fc8b-03c4-4b58-a98d-f849a19f2bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.512959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb5424-f696-4285-8385-46a2739215f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.514571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb5424-f696-4285-8385-46a2739215f7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.533016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-d610fc8b-03c4-4b58-a98d-f849a19f2bfd None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:00.534699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-d610fc8b-03c4-4b58-a98d-f849a19f2bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:00.550150 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 18/38] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:13:00 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:00.551469 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a65a02-fdc2-4a26-8260-db9b66756939 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.551922 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a65a02-fdc2-4a26-8260-db9b66756939 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.552142 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a65a02-fdc2-4a26-8260-db9b66756939 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.554878 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 19/39] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:00.554878 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a65a02-fdc2-4a26-8260-db9b66756939 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:00.647350 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 21/40] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:00.649239 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.649535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.649976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.669899 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:00.674398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:00.676674 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:00.715210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a65a02-fdc2-4a26-8260-db9b66756939 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.764132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.765137 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.765620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.765888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.767386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.769925 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.771976 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 20/41] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:00.779393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:00.782153 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 22/42] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:00.909024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc1e84-ff14-44a1-bce8-fc92658baef0 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:00.945649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:00.946536 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:00.946991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:00.947442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] PATH_INFO: `/v3/domains/default/users/661b53358e904910bb42d525c798f725/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:00.950112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=661b53358e904910bb42d525c798f725, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:00.951818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:00.963031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:00.970351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 21/43] 10.222.0.46 () {58 vars in 1361 bytes} [Thu Aug 18 19:13:00 2022] PUT /identity/v3/domains/default/users/661b53358e904910bb42d525c798f725/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:01.015780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:01.068996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:01.130586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:01.141750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928cbf4-a47e-4d67-b421-d6f6af711b46 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:01.194484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:01.195039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:01.195324 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:01.195600 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:01.196291 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:01.197758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:01.214882 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 18 19:13:01 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:01.293153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848ed04-0bf7-42f7-92bf-0d97a0226035 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:01.336297 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab10f-2f31-432f-8af0-a646eaf88c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:01.336648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab10f-2f31-432f-8af0-a646eaf88c13 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:01.336939 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab10f-2f31-432f-8af0-a646eaf88c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:01.337220 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab10f-2f31-432f-8af0-a646eaf88c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:01.338432 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ab10f-2f31-432f-8af0-a646eaf88c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:01.339942 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ab10f-2f31-432f-8af0-a646eaf88c13 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:01.341839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 22/45] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:01.347410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:01.469543 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b82b4-e660-49e0-8072-e405c3fabc2c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:01.473489 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:01.507800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f2cc-628d-4645-ab67-1a2cf5b0068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:01.508410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f2cc-628d-4645-ab67-1a2cf5b0068f None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:01.508702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f2cc-628d-4645-ab67-1a2cf5b0068f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:01.509001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f2cc-628d-4645-ab67-1a2cf5b0068f None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:01.509654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f2cc-628d-4645-ab67-1a2cf5b0068f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:01.511104 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f2cc-628d-4645-ab67-1a2cf5b0068f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:01.556715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:13:01 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:03.204479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80f06-a90f-4d92-a85d-b22c875d8736 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:03.205039 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80f06-a90f-4d92-a85d-b22c875d8736 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:03.205123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80f06-a90f-4d92-a85d-b22c875d8736 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:03.206398 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:03.212115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6c5b7-34b9-4cb9-ae3d-7cde0802711f None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:03.212550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6c5b7-34b9-4cb9-ae3d-7cde0802711f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:03.212780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6c5b7-34b9-4cb9-ae3d-7cde0802711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:03.231847 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-7cb6c5b7-34b9-4cb9-ae3d-7cde0802711f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:03.233099 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-7cb6c5b7-34b9-4cb9-ae3d-7cde0802711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:03.300138 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:03.627021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80f06-a90f-4d92-a85d-b22c875d8736 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:03.701916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:03.738060 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80f06-a90f-4d92-a85d-b22c875d8736 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:03.753408 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da166f28-f730-4a97-bac0-a2e4b0fddf63 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:03.753710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da166f28-f730-4a97-bac0-a2e4b0fddf63 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:03.753999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da166f28-f730-4a97-bac0-a2e4b0fddf63 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:03.755380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 26/49] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:03.760930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914768-eaea-41d0-9936-d97592468140 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:03.761224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914768-eaea-41d0-9936-d97592468140 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:03.761505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914768-eaea-41d0-9936-d97592468140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:03.773810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:03.774452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:03.774737 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:03.775013 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:03.779460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-8c914768-eaea-41d0-9936-d97592468140 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:03.780662 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-8c914768-eaea-41d0-9936-d97592468140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:03.786383 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:03.790404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:03.791284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:03.792037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 24/50] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:03.797283 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:03.847760 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 27/51] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:03.896469 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932df739-9bc1-44b5-8796-3035c5baeb42 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:03.921642 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:03.931064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:03.931679 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:03.931960 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:03.932237 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:03.932927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:03.933259 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:03.934608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:03.946772 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 25/52] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:03.953005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914768-eaea-41d0-9936-d97592468140 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:03.970813 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:04.053513 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914768-eaea-41d0-9936-d97592468140 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:04.090710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:04.091485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:04.091827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:04.092198 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:04.093621 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:04.095462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:04.096979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 28/53] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:03 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:04.103249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:04.174380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:04.205626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd012b-dc82-4e3c-be53-b65cec9e1320 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:04.240361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:04.241034 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:04.241389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:04.242174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:04.243348 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:04.244782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:04.246611 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 26/54] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:04.252292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:04.259729 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:04.276266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258982-ad28-48df-a52f-a108656753d4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:04.309081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:04.317724 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:04.318361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:04.318640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:04.318911 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:04.320098 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:04.321591 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:04.323174 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 29/55] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:04.328649 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:04.356874 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625bbc-e819-455f-bbe5-6c5d87627d85 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:04.392063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:04.392697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:04.393018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:04.393299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:04.394094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.domain.id=default, user.id=661b53358e904910bb42d525c798f725) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:04.394371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:04.395839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573085-a792-4d1c-ad49-e278f4a8087e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:04.404350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 27/56] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Aug 18 19:13:04 2022] GET /identity/v3/role_assignments?user.id=661b53358e904910bb42d525c798f725&scope.domain.id=default&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:04.435111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf14e41-a485-4009-ac24-e324cad4244f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:04.471611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d813afd-315a-4f1f-b553-40391c618880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:04.472260 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d813afd-315a-4f1f-b553-40391c618880 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:04.472554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d813afd-315a-4f1f-b553-40391c618880 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:04.472865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d813afd-315a-4f1f-b553-40391c618880 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:04.473529 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d813afd-315a-4f1f-b553-40391c618880 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:04.475280 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d813afd-315a-4f1f-b553-40391c618880 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:04.504712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 30/57] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Aug 18 19:13:04 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:13:06.698434 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c45cc-2b95-45df-a025-8abd836c9d65 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:06.698960 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c45cc-2b95-45df-a025-8abd836c9d65 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:06.699044 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c45cc-2b95-45df-a025-8abd836c9d65 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:06.700368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 28/58] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:06.705514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:06.705887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:06.706068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:06.713720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:06.726536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:06.727731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:06.810573 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 31/59] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:07.133591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c45cc-2b95-45df-a025-8abd836c9d65 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:07.236900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c45cc-2b95-45df-a025-8abd836c9d65 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:07.256622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:07.270953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf046c8-1ccd-4650-bd89-5ece587ae930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:07.271581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf046c8-1ccd-4650-bd89-5ece587ae930 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:07.271864 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf046c8-1ccd-4650-bd89-5ece587ae930 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:07.272140 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf046c8-1ccd-4650-bd89-5ece587ae930 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:07.273824 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf046c8-1ccd-4650-bd89-5ece587ae930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:07.275281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf046c8-1ccd-4650-bd89-5ece587ae930 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:07.276864 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 29/60] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:07.282439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:07.375799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46aad5-40b8-4fe4-8904-e3f2900d707b None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:07.409551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66b31b-9ffa-4bf9-8257-28c0f9da62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:07.410086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b31b-9ffa-4bf9-8257-28c0f9da62ce None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:07.410366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b31b-9ffa-4bf9-8257-28c0f9da62ce None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:07.410639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b31b-9ffa-4bf9-8257-28c0f9da62ce None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:07.411283 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b31b-9ffa-4bf9-8257-28c0f9da62ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:07.412765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b31b-9ffa-4bf9-8257-28c0f9da62ce None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:07.422374 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:07.440658 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 32/61] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:07 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:13:10.903272 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d71cc-768d-475f-b946-fbef7988c77c None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:10.904144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d71cc-768d-475f-b946-fbef7988c77c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:10.904571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d71cc-768d-475f-b946-fbef7988c77c None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:10.906092 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 30/62] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:10.911688 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1d278-3a4e-427d-bae3-5315a74e184f None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:10.912516 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1d278-3a4e-427d-bae3-5315a74e184f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:10.913026 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1d278-3a4e-427d-bae3-5315a74e184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:10.942083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-b8a1d278-3a4e-427d-bae3-5315a74e184f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:10.943316 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-b8a1d278-3a4e-427d-bae3-5315a74e184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:11.038390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 33/63] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:11.103611 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a27c8-4356-4777-b785-5852e4864b15 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.104391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a27c8-4356-4777-b785-5852e4864b15 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.104916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a27c8-4356-4777-b785-5852e4864b15 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.106526 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 31/64] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:11.112671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e07475-2635-41e1-8fff-fc7eef43a826 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.112995 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e07475-2635-41e1-8fff-fc7eef43a826 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.113278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e07475-2635-41e1-8fff-fc7eef43a826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.140708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-b4e07475-2635-41e1-8fff-fc7eef43a826 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:11.141924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-b4e07475-2635-41e1-8fff-fc7eef43a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:11.150169 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d15b0-e136-4550-9586-07c3c1970cdf None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.150456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d15b0-e136-4550-9586-07c3c1970cdf None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.150731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d15b0-e136-4550-9586-07c3c1970cdf None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.152643 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 32/65] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:11.159079 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b52f-1df7-43eb-8385-3f82a705b641 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.159883 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b52f-1df7-43eb-8385-3f82a705b641 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.160361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b52f-1df7-43eb-8385-3f82a705b641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.195796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-ece3b52f-1df7-43eb-8385-3f82a705b641 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:11.199530 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-ece3b52f-1df7-43eb-8385-3f82a705b641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:11.265930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 34/66] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:11.323423 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1474b7-56be-410a-b4dd-0872f527c0cc None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.324241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1474b7-56be-410a-b4dd-0872f527c0cc None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.324933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1474b7-56be-410a-b4dd-0872f527c0cc None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.327198 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 35/67] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:11.333855 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77edf4-7346-4030-aa2e-8e1ed46cd801 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.334566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77edf4-7346-4030-aa2e-8e1ed46cd801 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.335216 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77edf4-7346-4030-aa2e-8e1ed46cd801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.356788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 33/68] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:11.365814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-7b77edf4-7346-4030-aa2e-8e1ed46cd801 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:11.367925 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-7b77edf4-7346-4030-aa2e-8e1ed46cd801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:11.410850 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560483-c6fd-4630-b78d-6f4586782527 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.411553 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560483-c6fd-4630-b78d-6f4586782527 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.412153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560483-c6fd-4630-b78d-6f4586782527 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.413749 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 34/69] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:11.414703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560483-c6fd-4630-b78d-6f4586782527 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:11.425771 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:11.450707 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 36/70] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:11.452464 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.452980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.453477 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.486041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:11.488250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:11.581732 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560483-c6fd-4630-b78d-6f4586782527 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:11.618036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 37/71] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:11.621413 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:11.641181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:11.641927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.642310 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.642656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.653877 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:11.659036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:11.659875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:11.661118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 35/72] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:11.666884 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:11.668262 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:11.811671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970c92-ab45-42a6-99d0-62ac4afa3097 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:11.823678 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:11.834625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887fb8d-d182-46bb-989e-8f936a510180 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:11.851607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:11.852273 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.852553 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.852855 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.853617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:11.853941 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:11.855475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:11.864843 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 38/73] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:11.865675 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:11.881298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:11.882033 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:11.882318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:11.883062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:11.895557 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:11.901103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:11.902180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:11.902935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 36/74] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:11.904945 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:11.946107 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:11.981347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf447dec-06df-4da4-8827-c98e641c44d6 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.007978 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd096-1479-4ad7-b9a1-03cb48b4d1da None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.014761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.015418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.015692 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.015963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.027102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:12.032287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:12.033337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:12.034135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 39/75] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:12.034775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.049093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.049731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.050013 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.050286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.060291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:12.065021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:12.065962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:12.066731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 37/76] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:12.067371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.068456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.136284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df7144-2f32-49fc-b62c-de21b6b8f4d7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.164633 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.168415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d522db-e358-403c-ac01-fc8a2ae46f59 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.170114 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.170760 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.171744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.171744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.185656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.187149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.188832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 40/77] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.193578 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.203584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.204089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.204373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.204654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.205380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:12.205694 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.207075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.215638 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 38/78] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.216446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.288359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.298199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0382-82c6-4b9c-8709-fd1a8a486907 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.314689 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ea24f-c4e8-4583-a62c-5858e0df5b68 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.333073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.333712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.334000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.334282 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.335956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.337466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.340731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 41/79] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.340731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.350208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.350846 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.351127 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.351399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.352061 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:12.352361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.353769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.362132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 39/80] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.362967 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.388196 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.464660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35cf16-3e4e-4f41-ad76-47716f5a2c55 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.468077 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09009a86-94e9-42c7-a21b-6a3a536396b8 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.499300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.499917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.500205 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.500490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.501199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:12.501512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.501739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.502348 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.502632 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.502906 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.502993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.512080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 42/81] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.512756 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.539318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.581919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.583429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.608903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.626256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90e2d-05ee-4da9-85f0-3d32633d5d3c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.661396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.662040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.662325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.662613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.663742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.665245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.666828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 43/82] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.667577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.703890 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 40/83] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:12.704660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.760646 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.777367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92af4-02d6-4753-b744-8f88b2e89cec None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.812325 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613fa02-4faa-42ea-be15-9454968ce917 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:12.812717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.813358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.813639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.813994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.814565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.816025 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.838228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:12.839465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 44/84] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:12 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:12.840199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.857748 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:12.858387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:12.858672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:12.858947 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:12.860264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:12.861825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:12.863550 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 41/85] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:12.864393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:12.997454 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a5c48-8d1d-42f4-8b6d-8ccc7bcde80d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.020428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89145ceb-d57e-4e21-8cb4-d8ef2335cf89 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.049651 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.050543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.050833 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.051117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.068153 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.071577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.071577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.071577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.071577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.072335 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.076218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 45/86] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:13.079601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.098981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.130911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.147950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.149493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.226152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801500b7-770a-484d-be0e-3070f68c428f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.267682 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.268388 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.268672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.269022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.270562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.272366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.274988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 46/87] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:13.275870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.297867 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 42/88] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:13.304985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.414145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.440929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.443209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccf43e-2efe-4de2-b654-65f748f43b3b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.453776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8f195-bbc1-4183-bed2-6c859ac28b78 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.489507 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.490493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.491498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.492221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.502435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.502435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.502435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.502435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.599206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.601442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.608192 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.609827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.692928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.712704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.719609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 47/89] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:13.720930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.723896 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 43/90] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:13.729738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.838247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15807-8c66-481e-8979-8e761853cd5a None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.839401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5feeb28-ff51-46a4-a83d-cdc525bc9fd1 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:13.876675 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.876876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:13.877515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.877796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.878075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.878361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:13.878830 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:13.879206 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.879497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:13.880404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=13d25a9769a34aecaaeb423decbf57f2) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:13.880757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.881152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:13.882599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 44/91] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:13.883286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.883732 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:13.890244 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 48/92] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/role_assignments?user.id=13d25a9769a34aecaaeb423decbf57f2&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=99603dce58184be6bdfb41cb63477e74 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:13.896576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:13.947804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.984179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:13.995532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8d96a-3f34-4608-9504-f99ed2e79584 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:14.034477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:14.035137 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:14.035409 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:14.035684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:14.037328 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:14.039100 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:14.041245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 45/93] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:14.042007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:14.068580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35667d5-5412-4082-a133-39fa90f481eb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:14.112616 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:14.113698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:14.114175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:14.115085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] PATH_INFO: `/v3/projects/0ae20e6ca80448a2991259a680766d96` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:14.117378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] RBAC: Authorizing `identity:get_project(project_id=0ae20e6ca80448a2991259a680766d96)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:14.119104 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:14.121543 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 49/94] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:13 2022] GET /identity/v3/projects/0ae20e6ca80448a2991259a680766d96 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:14.122740 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:14.169362 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a04f-1309-43ad-a84e-064e7d68a4b6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:14.246669 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:14.267538 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:14.268552 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:14.269055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:14.269524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:14.270464 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=661b53358e904910bb42d525c798f725) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:14.271004 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:14.273227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:14.289783 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 46/95] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:14 2022] GET /identity/v3/role_assignments?user.id=661b53358e904910bb42d525c798f725&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:14.292533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:14.299754 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29768a-060c-435a-820e-3979aa484dcd None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:14.333258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:14.380999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:14.382564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:14.385149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:14.385665 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:14.386675 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] RBAC: Adding query filter params (role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=13d25a9769a34aecaaeb423decbf57f2) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:14.389947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:14.391749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516be35b-bf83-4e5c-81bd-419f19649619 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:14.402940 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 50/96] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:14 2022] GET /identity/v3/role_assignments?user.id=13d25a9769a34aecaaeb423decbf57f2&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:14.527389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4109e-64b4-45d4-af56-9645e1f4911d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:14.574640 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:14.575701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:14.576209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:14.576795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:14.577822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=0ae20e6ca80448a2991259a680766d96, user.id=13d25a9769a34aecaaeb423decbf57f2) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:14.578367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:14.580299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bdf27-f5d2-4009-a846-18bcaed97ed9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:14.595169 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 47/97] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:14 2022] GET /identity/v3/role_assignments?user.id=13d25a9769a34aecaaeb423decbf57f2&scope.project.id=0ae20e6ca80448a2991259a680766d96&role.id=99603dce58184be6bdfb41cb63477e74 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:15.700512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc855c4-a911-47ae-8580-b61e0e79f450 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:15.701059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc855c4-a911-47ae-8580-b61e0e79f450 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:15.701132 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc855c4-a911-47ae-8580-b61e0e79f450 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:15.702466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 51/98] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:15.708292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0c5c-e4ff-4fb4-99c1-e7700ad8ed96 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:15.708891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0c5c-e4ff-4fb4-99c1-e7700ad8ed96 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:15.708891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0c5c-e4ff-4fb4-99c1-e7700ad8ed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:15.737905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-6f3b0c5c-e4ff-4fb4-99c1-e7700ad8ed96 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:15.739141 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-6f3b0c5c-e4ff-4fb4-99c1-e7700ad8ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:15.815192 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:15.839368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 48/99] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:15.946979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73388a9-3e16-404d-88b9-0ba98313bf0b None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:15.947605 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73388a9-3e16-404d-88b9-0ba98313bf0b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:15.948080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73388a9-3e16-404d-88b9-0ba98313bf0b None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:15.949677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 52/100] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:15.955505 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:15.956064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:15.956603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:15.985760 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:15.987308 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:16.081303 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 49/101] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:16.421442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73388a9-3e16-404d-88b9-0ba98313bf0b None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:16.540229 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73388a9-3e16-404d-88b9-0ba98313bf0b None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:16.579754 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:16.580889 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:16.581369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:16.581865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:16.594541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:16.600001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:16.600988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:16.601757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:16.605226 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 53/102] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:16.611481 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:16.754028 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202700-ad78-46bd-a23d-170990c65229 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:16.771043 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:16.798470 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:16.799528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:16.800049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:16.800521 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:16.801496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:16.802013 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:16.804178 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:16.812796 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:16.817377 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 50/103] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:16.826179 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:16.873001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:16.943942 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e37db-013b-41e8-b0c8-ea240383f817 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:16.982068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:16.983118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:16.983595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:16.984119 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:16.985836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:16.987631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:16.989700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 54/104] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:16.996906 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:17.072985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d376c-3e75-4142-bcd7-341a012765ae None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:17.111803 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65196-8db7-481b-bef6-77ba9f3bca1e None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:17.114676 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:17.152828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8406cd-86cc-49b3-bf09-9effc6aab3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:17.153919 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8406cd-86cc-49b3-bf09-9effc6aab3cd None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.154401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8406cd-86cc-49b3-bf09-9effc6aab3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.154892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8406cd-86cc-49b3-bf09-9effc6aab3cd None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.155848 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8406cd-86cc-49b3-bf09-9effc6aab3cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:17.157517 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8406cd-86cc-49b3-bf09-9effc6aab3cd None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:17.158784 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e56b6-ba21-434b-87d5-f4941b3ba481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:17.159440 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e56b6-ba21-434b-87d5-f4941b3ba481 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.159730 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e56b6-ba21-434b-87d5-f4941b3ba481 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.160014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e56b6-ba21-434b-87d5-f4941b3ba481 None admin] PATH_INFO: `/v3/users/3c5ce542e6994389b1f9f8d96a5054b0` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.188511 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e56b6-ba21-434b-87d5-f4941b3ba481 None admin] RBAC: Authorizing `identity:get_user(user_id=3c5ce542e6994389b1f9f8d96a5054b0)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:17.191304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e56b6-ba21-434b-87d5-f4941b3ba481 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:17.192177 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 55/105] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:13:16 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:13:17.195118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71871-0296-4aea-a94e-688dca7811ac None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.196628 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71871-0296-4aea-a94e-688dca7811ac None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.197149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71871-0296-4aea-a94e-688dca7811ac None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.197586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 51/106] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:16 2022] GET /identity/v3/users/3c5ce542e6994389b1f9f8d96a5054b0 => generated 289 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:17.199373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 56/107] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:17.209001 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.209342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.209627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.210824 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71871-0296-4aea-a94e-688dca7811ac None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:17.245359 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:17.253002 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:17.341882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:17.396281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71871-0296-4aea-a94e-688dca7811ac None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:17.439349 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:17.440480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.441027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.441629 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.471690 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:17.479011 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 52/108] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:17.526672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:17.528718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:17.634527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 57/109] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:17.640370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:17.782093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e4ba-265a-40a7-a817-ad00c16beeba None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:17.827712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb916-6467-42c4-9496-587ef5bc1b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:17.828423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb916-6467-42c4-9496-587ef5bc1b88 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.828873 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb916-6467-42c4-9496-587ef5bc1b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.829084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb916-6467-42c4-9496-587ef5bc1b88 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.830346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb916-6467-42c4-9496-587ef5bc1b88 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:17.831859 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb916-6467-42c4-9496-587ef5bc1b88 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:17.833885 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 53/110] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:17 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:17.839756 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:17.934036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:17.967768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f38e-48e5-4902-8d43-152626c9b1d5 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.968075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f38e-48e5-4902-8d43-152626c9b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.968325 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f38e-48e5-4902-8d43-152626c9b1d5 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.969851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 54/111] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:17.980092 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:17.980399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:17.980636 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:17.993225 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59352db-10dc-4b7d-af3f-aea42e2678c2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:17.999668 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:18.000921 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:18.032634 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:18.074393 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:18.075027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.075427 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.075701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.076805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] RBAC: Adding query filter params (role.id=628bd929b8bb42a5bfaaee51144e6445, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=3c5ce542e6994389b1f9f8d96a5054b0) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:18.077652 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:18.078456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 55/112] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:18.079706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:18.083739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:18.097016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 58/113] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:17 2022] GET /identity/v3/role_assignments?user.id=3c5ce542e6994389b1f9f8d96a5054b0&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=628bd929b8bb42a5bfaaee51144e6445 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:18.195601 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c09f59-f214-4401-a8ae-4740d18c7e08 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:18.240227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c88105-4dc1-41ff-a788-3063c492f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:18.240946 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c88105-4dc1-41ff-a788-3063c492f948 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.241778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c88105-4dc1-41ff-a788-3063c492f948 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.242060 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c88105-4dc1-41ff-a788-3063c492f948 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.259094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c88105-4dc1-41ff-a788-3063c492f948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-c5c88105-4dc1-41ff-a788-3063c492f948 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:18.264025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:18.264917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:18.265704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 56/114] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:18.271168 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:18.283354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d51f8-c766-4fb1-91b0-8ff9cee8ac0a None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.283652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d51f8-c766-4fb1-91b0-8ff9cee8ac0a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.283938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d51f8-c766-4fb1-91b0-8ff9cee8ac0a None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.285320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 57/115] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:18.298452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.298750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.299016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.329938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:18.331018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:18.358868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:18.458118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 58/116] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:18.485683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b7d91-8ea0-486e-85fb-a14817cbda34 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:18.518905 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:18.551902 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:18.552530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.552860 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.553131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.554369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:18.554683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:18.556079 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:18.575912 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 59/117] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:18.581582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:18.678315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:18.733892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aa254-d4d3-4793-b4f3-22f5484ca6aa None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:18.805487 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfe5fb-79f9-430b-bd77-133bf3e68f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:18.806115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe5fb-79f9-430b-bd77-133bf3e68f3e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.806410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe5fb-79f9-430b-bd77-133bf3e68f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.806691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe5fb-79f9-430b-bd77-133bf3e68f3e None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.810120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfe5fb-79f9-430b-bd77-133bf3e68f3e None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:18.811768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfe5fb-79f9-430b-bd77-133bf3e68f3e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:18.813623 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 59/118] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:18 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:18.817483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1810bd-f781-4a2c-9995-87c4491d4b84 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.817968 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1810bd-f781-4a2c-9995-87c4491d4b84 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.818445 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1810bd-f781-4a2c-9995-87c4491d4b84 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.825336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 60/119] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:18.826369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1810bd-f781-4a2c-9995-87c4491d4b84 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:18.856291 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3006e5-0fdb-4ff4-8549-40943bc251af None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:18.872605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:18.930358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73108f9b-ad30-4358-bfea-c4e08bdc5f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:18.931013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73108f9b-ad30-4358-bfea-c4e08bdc5f08 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.931300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73108f9b-ad30-4358-bfea-c4e08bdc5f08 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.931580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73108f9b-ad30-4358-bfea-c4e08bdc5f08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.965679 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73108f9b-ad30-4358-bfea-c4e08bdc5f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-73108f9b-ad30-4358-bfea-c4e08bdc5f08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:18.971066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:18.971921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:18.972712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 60/120] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:18.974152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:18.974152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:18.974152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:18.997290 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1810bd-f781-4a2c-9995-87c4491d4b84 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.011766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:19.014115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:19.035109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.035847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.036209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.036559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.038393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:19.039930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:19.041738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 61/121] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:18 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:19.042734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.078682 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:19.112851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 61/122] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:19.114226 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.176160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:19.203812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c59faf-e68d-4e7e-8907-faa2371e36a2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.246774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b6280-b5c8-4705-b16f-bd22a7974bf6 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.270915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.271992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.273785 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.274442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.275917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:19.276596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:19.278896 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:19.296082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 62/123] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:19.298673 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.322396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.323585 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.324513 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.324987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.339284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:19.346508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:19.347432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:19.348399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:19.351360 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 62/124] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:19.352484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.410110 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:19.504383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aea5-7508-4d4b-a014-4a2b094b318d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.523649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043c3e-15c2-4e7b-b7e9-1321f9348262 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.557197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.558362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.559275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.559733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.561744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:19.564327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:19.566644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 63/125] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:19.567663 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.573247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.573942 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.574229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.574509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312/users/13d25a9769a34aecaaeb423decbf57f2/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.576659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83a91e77c5b46668ddb61809821a312, user_id=13d25a9769a34aecaaeb423decbf57f2, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:19.578216 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:19.601085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 63/126] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:19 2022] PUT /identity/v3/projects/e83a91e77c5b46668ddb61809821a312/users/13d25a9769a34aecaaeb423decbf57f2/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:19.601949 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.617052 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:19.754434 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607ef93-0100-4153-a879-90e0175a9ae0 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.766170 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:19.777975 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3204a-efd5-4acc-ba6f-cf2277809b53 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.796747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.797416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.797705 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.797986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.810309 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:19.815822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:19.816847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:19.817650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:19.821180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 64/127] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:19.822277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.863559 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.865895 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.866396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.866869 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.867744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:19.868778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:19.870383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:19.882335 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 64/128] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:19.883654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:19.906531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:19.944907 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2508-53ad-46ef-ad55-b1314e3e35ce None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:19.988503 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:19.989830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:19.990260 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:19.991096 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:19.992708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:19.995034 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:19.997139 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 65/129] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:19.998049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.016291 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9c4a5-2650-49b1-8dcf-a05c50274510 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.056747 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.057289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.057680 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.058062 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.058858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:20.059258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.061049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.071047 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 65/130] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:20.071824 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.112919 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:20.161987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c004-3da6-45b0-8934-b2535689305c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.243190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.244485 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.246165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.246469 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.248236 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.249799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.253008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 66/131] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:19 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:20.255530 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.275528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:20.305401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8518-445f-496b-96af-77d24f72e966 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.372138 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.372845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.373139 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.373624 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312/users/13d25a9769a34aecaaeb423decbf57f2/roles/691ab61f8d304445b4d604bb4e2ff005` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.377966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83a91e77c5b46668ddb61809821a312, user_id=13d25a9769a34aecaaeb423decbf57f2, role_id=691ab61f8d304445b4d604bb4e2ff005)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.379412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.383177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab515e-b4f6-4c52-b963-a2c2e40e6e1b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.403055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 66/132] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:20 2022] PUT /identity/v3/projects/e83a91e77c5b46668ddb61809821a312/users/13d25a9769a34aecaaeb423decbf57f2/roles/691ab61f8d304445b4d604bb4e2ff005 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:20.403981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.427757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.430122 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.430646 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.431907 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.433634 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.436849 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.439565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 67/133] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:20 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:20.448502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.591908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:20.621694 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:20.636631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5081f5-736a-4e3a-8eab-35290b2da654 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.657456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda1798-bc20-496b-ae0d-0a257a1baaaf None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.677578 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f4409-1fe8-4e91-bf1d-69d787a15940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.678358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f4409-1fe8-4e91-bf1d-69d787a15940 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.678720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f4409-1fe8-4e91-bf1d-69d787a15940 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.679003 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f4409-1fe8-4e91-bf1d-69d787a15940 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.681054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f4409-1fe8-4e91-bf1d-69d787a15940 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.682539 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f4409-1fe8-4e91-bf1d-69d787a15940 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.684419 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 67/134] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:20 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:20.685447 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c7af-abc9-432e-8415-4d6a1ea10988 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.685737 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c7af-abc9-432e-8415-4d6a1ea10988 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.686070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c7af-abc9-432e-8415-4d6a1ea10988 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.687346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 68/135] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:20.696418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.696760 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.697049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.699914 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.700598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.700915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.701190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] PATH_INFO: `/v3/projects/0ae20e6ca80448a2991259a680766d96` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.702869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] RBAC: Authorizing `identity:get_project(project_id=0ae20e6ca80448a2991259a680766d96)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.704317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.706176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 68/136] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:20 2022] GET /identity/v3/projects/0ae20e6ca80448a2991259a680766d96 => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:20.706714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.727973 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:20.729307 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:20.836865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 69/137] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:20.837979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:20.842594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207f03-bebc-4e9c-b20e-40c2fd819b9d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:20.878996 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2f57b-64e3-463a-a41f-3516cfe68999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:20.879664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f57b-64e3-463a-a41f-3516cfe68999 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.879945 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f57b-64e3-463a-a41f-3516cfe68999 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.880220 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f57b-64e3-463a-a41f-3516cfe68999 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312/users/661b53358e904910bb42d525c798f725/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.883551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2f57b-64e3-463a-a41f-3516cfe68999 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83a91e77c5b46668ddb61809821a312, user_id=661b53358e904910bb42d525c798f725, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:20.885019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2f57b-64e3-463a-a41f-3516cfe68999 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:20.900298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 69/138] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:20 2022] PUT /identity/v3/projects/e83a91e77c5b46668ddb61809821a312/users/661b53358e904910bb42d525c798f725/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:20.901353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37a62-ae53-4f39-b1ce-dcaa43bd6de6 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.901706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37a62-ae53-4f39-b1ce-dcaa43bd6de6 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.902017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37a62-ae53-4f39-b1ce-dcaa43bd6de6 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.903487 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 70/139] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:20.909358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:20.909745 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:20.910031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:20.917205 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:20.931985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:20.933411 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:20.938959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:20.959846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe38b75-d3e0-4aad-a6cc-64a7f5f86f65 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:21.040735 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:21.042689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:21.043579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:21.044082 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] PATH_INFO: `/v3/projects/0ae20e6ca80448a2991259a680766d96/users/13d25a9769a34aecaaeb423decbf57f2/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:21.050558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae20e6ca80448a2991259a680766d96, user_id=13d25a9769a34aecaaeb423decbf57f2, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:21.052131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:21.056985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 71/140] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:21.081441 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 70/141] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:20 2022] PUT /identity/v3/projects/0ae20e6ca80448a2991259a680766d96/users/13d25a9769a34aecaaeb423decbf57f2/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:21.445275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:21.470569 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:21.581226 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4d31-839d-4707-bf6f-0f44e9009b3c None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:21.624329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:21.633742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:21.635365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:21.636006 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:21.636491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:21.652977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:21.655233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ce63-9fc7-48f6-96f9-f37a0e711679 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:21.658712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:21.659765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:21.660567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 72/142] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:21.665540 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:21.708715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:21.709967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:21.710446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:21.711451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:21.712857 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:21.715020 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:21.717579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 71/143] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:21.728715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:21.752659 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:21.824267 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5a9d-d92d-48aa-b772-dde8398d29e4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:21.865505 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:21.866213 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:21.866493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:21.866776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:21.867515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:21.867824 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:21.869241 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:21.883300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 73/144] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:21.888724 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:21.919212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e347-770e-425d-8a47-719499d7ab10 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:21.977162 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:22.003511 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835389f0-0886-4760-b9eb-56f25e93ade3 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:22.007357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:22.007982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:22.008266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:22.008538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:22.009219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:22.010847 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:22.043858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:22.044508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:22.044867 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:22.045147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] PATH_INFO: `/v3/users/3c5ce542e6994389b1f9f8d96a5054b0` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:22.046354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=3c5ce542e6994389b1f9f8d96a5054b0)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:22.047810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:22.049555 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 74/145] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:21 2022] GET /identity/v3/users/3c5ce542e6994389b1f9f8d96a5054b0 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:22.050659 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 72/146] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:21 2022] POST /identity/v3/users => generated 283 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:13:22.055732 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:22.171630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85effd04-90e0-438c-85bf-fa9178989dd9 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:22.201410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:22.211167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507739-aaec-4548-a24e-0a40300900d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:22.212024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507739-aaec-4548-a24e-0a40300900d8 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:22.212371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507739-aaec-4548-a24e-0a40300900d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:22.212917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507739-aaec-4548-a24e-0a40300900d8 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:22.214154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1507739-aaec-4548-a24e-0a40300900d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:22.215661 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1507739-aaec-4548-a24e-0a40300900d8 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:22.220987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 75/147] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:22 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:22.226128 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:22.329840 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:22.375277 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5b88b-b04f-46d9-86d3-7d03dc08853c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:22.424719 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20c05a-2cb8-4bb5-81a6-f3d2342ce35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:22.425644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c05a-2cb8-4bb5-81a6-f3d2342ce35a None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:22.426076 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c05a-2cb8-4bb5-81a6-f3d2342ce35a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:22.426504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c05a-2cb8-4bb5-81a6-f3d2342ce35a None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312/users/3c5ce542e6994389b1f9f8d96a5054b0/roles/628bd929b8bb42a5bfaaee51144e6445` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:22.433982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c05a-2cb8-4bb5-81a6-f3d2342ce35a None admin] RBAC: Authorizing `identity:create_grant(project_id=e83a91e77c5b46668ddb61809821a312, user_id=3c5ce542e6994389b1f9f8d96a5054b0, role_id=628bd929b8bb42a5bfaaee51144e6445)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:22.435618 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c05a-2cb8-4bb5-81a6-f3d2342ce35a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:22.450843 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 73/148] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:22 2022] PUT /identity/v3/projects/e83a91e77c5b46668ddb61809821a312/users/3c5ce542e6994389b1f9f8d96a5054b0/roles/628bd929b8bb42a5bfaaee51144e6445 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:23.018662 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ac21-cf4d-492d-8bcf-f0fed43babf8 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:23.019165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ac21-cf4d-492d-8bcf-f0fed43babf8 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:23.019165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ac21-cf4d-492d-8bcf-f0fed43babf8 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:23.020522 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 76/149] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:23.025959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4591fb-13c8-426d-8044-c5a7b62ae654 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:23.026406 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4591fb-13c8-426d-8044-c5a7b62ae654 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:23.026501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4591fb-13c8-426d-8044-c5a7b62ae654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:23.049549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-fd4591fb-13c8-426d-8044-c5a7b62ae654 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:23.050912 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-fd4591fb-13c8-426d-8044-c5a7b62ae654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:23.134967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 74/150] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:23.519459 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9c5ae-7c86-47d9-bfb6-34154d3b0bb4 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:23.519797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9c5ae-7c86-47d9-bfb6-34154d3b0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:23.520012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9c5ae-7c86-47d9-bfb6-34154d3b0bb4 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:23.521429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 77/151] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:23.527619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:23.527915 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:23.528199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:23.553740 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:23.555105 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:23.639490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:23.664509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 75/152] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:23.868368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9c5ae-7c86-47d9-bfb6-34154d3b0bb4 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:23.995636 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9c5ae-7c86-47d9-bfb6-34154d3b0bb4 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:24.036298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:24.037062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.037331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.037731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.049456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:24.054390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:24.055247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:24.056081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 78/153] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:24.061484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:24.179596 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718265-85c4-4f19-a189-5705aef62dee None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:24.216274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:24.216935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.217218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.217495 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.218171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:24.218474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:24.219873 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:24.229613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 76/154] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:24.237438 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:24.300027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:24.365146 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ace0-4df4-490a-bca8-c4d497239247 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:24.399851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:24.409662 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:24.410492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.410780 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.411058 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.412253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:24.416273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:24.418893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 79/155] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:24 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:24.425477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:24.502088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:24.540205 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb764c-92ed-4994-adba-f17f23c14680 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:24.573062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:24.575643 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad882f-c0cb-4eaf-a63d-317783017757 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:24.603754 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273505fa-855b-4157-86dd-e5c7b68f2d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:24.604965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273505fa-855b-4157-86dd-e5c7b68f2d50 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.605553 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273505fa-855b-4157-86dd-e5c7b68f2d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.606018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273505fa-855b-4157-86dd-e5c7b68f2d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.645409 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed9eaf-fb02-4b3b-bf94-57174ff65da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:24.646059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9eaf-fb02-4b3b-bf94-57174ff65da6 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.646532 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9eaf-fb02-4b3b-bf94-57174ff65da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.646960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9eaf-fb02-4b3b-bf94-57174ff65da6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.665881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed9eaf-fb02-4b3b-bf94-57174ff65da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-caed9eaf-fb02-4b3b-bf94-57174ff65da6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:24.680346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:24.681436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:24.682284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:24.684073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 77/156] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:24.685580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358f1b-6ceb-48a3-ae96-48258fe2fbb4 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.686018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358f1b-6ceb-48a3-ae96-48258fe2fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.686515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358f1b-6ceb-48a3-ae96-48258fe2fbb4 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.687973 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 78/157] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:24.694669 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273505fa-855b-4157-86dd-e5c7b68f2d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:24.695800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358f1b-6ceb-48a3-ae96-48258fe2fbb4 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:24.695904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273505fa-855b-4157-86dd-e5c7b68f2d50 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:24.859118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 80/158] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:13:24.864370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57a38d-6be5-480f-b1fd-a367dc55f7ee None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.864745 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57a38d-6be5-480f-b1fd-a367dc55f7ee None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.865031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57a38d-6be5-480f-b1fd-a367dc55f7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:24.897810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7d57a38d-6be5-480f-b1fd-a367dc55f7ee None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:24.899026 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7d57a38d-6be5-480f-b1fd-a367dc55f7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:24.918066 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:24.924905 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358f1b-6ceb-48a3-ae96-48258fe2fbb4 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:24.943051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:24.992676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 81/159] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:24.996096 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c292-07ae-4754-9caf-05cb32be4431 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:24.997441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c292-07ae-4754-9caf-05cb32be4431 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:24.998620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c292-07ae-4754-9caf-05cb32be4431 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.001930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 82/160] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:25.004394 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c292-07ae-4754-9caf-05cb32be4431 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:25.023303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:25.024200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.025937 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.029133 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.030206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:25.030728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:25.032349 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38576b87-305a-4604-95c5-3b4ba6583684 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:25.044258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 79/161] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:25.046964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.047541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.048045 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.073735 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:25.076662 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:25.205246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 80/162] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:25.207380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:25.258762 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c292-07ae-4754-9caf-05cb32be4431 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:25.369489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:25.370228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.370536 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.370806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.372013 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:25.373490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:25.375135 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 83/163] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:25 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:25.383459 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:25.388044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f32a-200a-4def-ba3a-2e6450384094 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:25.392963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:25.434170 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:25.446600 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:25.447740 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.448242 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.448744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.450147 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:25.452112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:25.458716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 81/164] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:25 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:25.463706 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:25.555347 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ec2f-f179-43f3-b3ae-363035dd0679 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:25.600483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:25.601468 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.601949 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.602428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.603430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=13d25a9769a34aecaaeb423decbf57f2) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:25.603946 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:25.605674 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:25.623124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 84/165] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:25 2022] GET /identity/v3/role_assignments?user.id=13d25a9769a34aecaaeb423decbf57f2&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=99603dce58184be6bdfb41cb63477e74 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:25.643364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f425f-695f-404c-8114-3743d59b6072 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:25.694869 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:25.695870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.696358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.696865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.710455 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:25.761055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:25.828506 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:25.831342 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:25.832929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:25.861554 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc3f4-61d5-498e-af5f-f3e199fec44c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:25.906425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:25.907158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:25.907440 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:25.907711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:25.930337 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:25.940016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:25.940985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 85/166] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:25.942008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.030598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 82/167] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:26.035330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.123977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2471c-64eb-4714-8805-52aa45488744 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:26.181722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:26.199383 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:26.200034 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.200314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.200589 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.220488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:26.221705 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:26.227980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:26.228923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:26.229709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 86/168] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:26.230349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.255766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b44c-ffdf-4d66-8efc-29935d41880c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:26.361461 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:26.362416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.362416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.362683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.363308 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:26.363618 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:26.365061 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:26.378554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 83/169] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:26.379434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.492338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2484ca-95da-4234-8ece-825229151728 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:26.508706 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c61b3-712d-4969-8fcf-a9f1749300d9 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:26.538289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:26.542538 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:26.544792 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.544792 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.544792 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.546313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:26.548386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:26.550645 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 87/170] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:26 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:26.551919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.553914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:26.554852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.555359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.555800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.556645 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:26.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:26.559475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234680b1-b849-47ff-af0e-e2315ca43bd3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:26.578339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 84/171] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:26.579927 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf47b1-7560-40ce-b574-4598c8acd237 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.581688 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf47b1-7560-40ce-b574-4598c8acd237 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.582808 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf47b1-7560-40ce-b574-4598c8acd237 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.584537 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 85/172] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:26.587132 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf47b1-7560-40ce-b574-4598c8acd237 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.689238 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:26.746292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0360360-5508-4bcc-9299-71104a5c4dd5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:26.765962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf47b1-7560-40ce-b574-4598c8acd237 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:26.784663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:26.786624 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.786906 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.787182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] PATH_INFO: `/v3/users/661b53358e904910bb42d525c798f725` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.790526 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] RBAC: Authorizing `identity:get_user(user_id=661b53358e904910bb42d525c798f725)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:26.794898 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:26.805977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 88/173] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:26 2022] GET /identity/v3/users/661b53358e904910bb42d525c798f725 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:26.806887 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:26.842005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:26.842694 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.842974 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.843247 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.845267 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] RBAC: Adding query filter params (role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=13d25a9769a34aecaaeb423decbf57f2) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:26.847186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:26.851323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b690e20-beaf-4b97-ac79-0490bb7ed16e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:26.862868 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 86/174] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:26 2022] GET /identity/v3/role_assignments?user.id=13d25a9769a34aecaaeb423decbf57f2&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:26.873294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b5e2-551b-491c-bee0-a3d252f67de2 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:26.873612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b5e2-551b-491c-bee0-a3d252f67de2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:26.873895 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b5e2-551b-491c-bee0-a3d252f67de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:26.916663 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-6d38b5e2-551b-491c-bee0-a3d252f67de2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:26.917890 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-6d38b5e2-551b-491c-bee0-a3d252f67de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:27.016399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d21a-7217-4f44-8952-811f9b70c25c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:27.048828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.062510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:27.063161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.063439 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.063995 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] PATH_INFO: `/v3/users/13d25a9769a34aecaaeb423decbf57f2` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.066353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] RBAC: Authorizing `identity:get_user(user_id=13d25a9769a34aecaaeb423decbf57f2)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:27.068089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:27.071231 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 89/175] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:26 2022] GET /identity/v3/users/13d25a9769a34aecaaeb423decbf57f2 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:27.072046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.082964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.097963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 87/176] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:27.099066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198c7b7-784e-46f9-8b20-a60e72dff699 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.099350 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198c7b7-784e-46f9-8b20-a60e72dff699 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.099619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198c7b7-784e-46f9-8b20-a60e72dff699 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.101261 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 88/177] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:27.101961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198c7b7-784e-46f9-8b20-a60e72dff699 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.221103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320cec7-fdf8-4867-a9e7-497ace0434d1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:27.265514 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef8c0d-7a83-4eb6-bc0e-2192790fbacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:27.266197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8c0d-7a83-4eb6-bc0e-2192790fbacd None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.266534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8c0d-7a83-4eb6-bc0e-2192790fbacd None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.266747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8c0d-7a83-4eb6-bc0e-2192790fbacd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.305397 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198c7b7-784e-46f9-8b20-a60e72dff699 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:27.340576 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef8c0d-7a83-4eb6-bc0e-2192790fbacd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:27.342093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef8c0d-7a83-4eb6-bc0e-2192790fbacd None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:27.353048 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.358347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:27.358966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.359243 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.359512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.453097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.458568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 90/178] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:27.460081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.460395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.464820 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.474757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:27.477349 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:27.487775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:27.489010 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:27.571774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 91/179] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:27.572568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.611886 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.641897 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 89/180] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:27.642626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.708420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978721c7-eafb-490b-a170-2f3cb9314849 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:27.749677 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:27.750460 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.750742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.751011 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.752203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:27.753790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:27.755712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 92/181] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:27.756664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.778576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.795011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47acb-3c35-4600-a28d-aa32527a0862 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:27.841308 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:27.842352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.843117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.843468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.858057 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:27.864145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:27.865054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:27.866405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 90/182] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:27.868096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.874834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65316-bc17-4719-9711-8946c4224247 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:27.885089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:27.911300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3eb57-e7be-443e-85e3-a063e660281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:27.912265 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3eb57-e7be-443e-85e3-a063e660281e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.912573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3eb57-e7be-443e-85e3-a063e660281e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.912889 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3eb57-e7be-443e-85e3-a063e660281e None admin] PATH_INFO: `/v3/projects/0ae20e6ca80448a2991259a680766d96` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.914035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3eb57-e7be-443e-85e3-a063e660281e None admin] RBAC: Authorizing `identity:get_project(project_id=0ae20e6ca80448a2991259a680766d96)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:27.915507 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3eb57-e7be-443e-85e3-a063e660281e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:27.917276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 93/183] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/projects/0ae20e6ca80448a2991259a680766d96 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:27.922234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1db6d-20bd-4191-9f9b-fcd0e729a3d1 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:27.922234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1db6d-20bd-4191-9f9b-fcd0e729a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:27.922234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1db6d-20bd-4191-9f9b-fcd0e729a3d1 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:27.922234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 94/184] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:27.922234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1db6d-20bd-4191-9f9b-fcd0e729a3d1 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:27.988647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663294b1-de8f-4847-a8ed-489f5c404a87 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.022601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.023218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.023500 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.023773 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.024494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=661b53358e904910bb42d525c798f725) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:28.024834 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.026278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c20029-40a4-4617-b9b3-dfcf0878a1c6 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.031849 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 91/185] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/role_assignments?user.id=661b53358e904910bb42d525c798f725&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:28.031965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1db6d-20bd-4191-9f9b-fcd0e729a3d1 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.033096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb1845-ee1e-4ebb-9af8-11a0b1273e84 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.033383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb1845-ee1e-4ebb-9af8-11a0b1273e84 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.033657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb1845-ee1e-4ebb-9af8-11a0b1273e84 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.034874 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 92/186] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:28.035580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb1845-ee1e-4ebb-9af8-11a0b1273e84 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.050020 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.085667 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.086300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.086580 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.086858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.087544 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:28.087851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.089305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e3a8-6900-4778-9d9f-4131a0cf783e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.104258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 95/187] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:28.104258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.104258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.104258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.121691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:28.123003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:28.153174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.161768 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb1845-ee1e-4ebb-9af8-11a0b1273e84 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.201366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 96/188] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:28.201781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.202406 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.202781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.203054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.203813 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=0ae20e6ca80448a2991259a680766d96, user.id=13d25a9769a34aecaaeb423decbf57f2) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:28.204108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.205706 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b4f4c-4acb-433a-a525-be2b76479e18 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.214218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 93/189] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/role_assignments?user.id=13d25a9769a34aecaaeb423decbf57f2&scope.project.id=0ae20e6ca80448a2991259a680766d96&role.id=99603dce58184be6bdfb41cb63477e74 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:28.214218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.214444 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.214536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.214536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.239112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:28.242205 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:28.346721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 94/190] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:28.346721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.358544 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4036-c5c7-4825-9b02-36cfd983e201 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.361284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.422117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.423103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.423387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.424019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.440162 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:28.445182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:28.446123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:28.446927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 97/191] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:28.453770 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.491471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f97b6-b799-4773-a70b-cecd259d7b4e None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.493642 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.532238 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.533162 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.533580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.534026 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] PATH_INFO: `/v3/users/3c5ce542e6994389b1f9f8d96a5054b0` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.535172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] RBAC: Authorizing `identity:get_user(user_id=3c5ce542e6994389b1f9f8d96a5054b0)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.536608 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.538969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 95/192] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/users/3c5ce542e6994389b1f9f8d96a5054b0 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:28.544256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.605468 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e3a1-14fb-47ae-93aa-1d15e1879cbb None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.639233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.655856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.658095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.658095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.658095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.658377 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:28.658561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.660336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.674442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 98/193] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:28.675404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.681967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df2d0e-1efb-4c9b-af35-f4a7e3cd8081 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.721172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.721881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.722163 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.722436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.774028 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.799588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae60a9f-92cd-4735-ac4d-06f1f110aa1f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.802271 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.803808 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.843229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.843857 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.844133 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.844403 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.845528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:28.846950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:28.848495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 99/194] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:28.852919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.876240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:28.909431 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 96/195] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:28.910295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:28.950629 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae368d0-0b84-4f42-af14-4c83e121071f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:28.984239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:28.984888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:28.985166 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:28.985438 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] PATH_INFO: `/v3/users/2c6afe4f76fb465eb7234945567e1221` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:28.999031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6afe4f76fb465eb7234945567e1221)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.000471 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.002198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 100/196] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/users/2c6afe4f76fb465eb7234945567e1221 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:29.002933 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.009792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569fa32-2764-4eaa-b2c2-ff6a92456319 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.014735 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.044728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.045362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.045641 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.045911 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.056313 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:29.061028 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:29.062069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:29.062845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 97/197] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:29.063497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.095054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.111687 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b092a2-1748-430b-9420-945e8e2ed1f5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.148146 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.148792 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.149076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.149344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.149986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.151417 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.165785 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7fa5d-c379-4ce5-b9a5-ab0e76e61fa4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.192827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 101/198] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:29 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:29.192827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.210142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.211178 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.211433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.211707 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.213163 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.214960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.217070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 98/199] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:29.217681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.264739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.304000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a427fa-5317-44c1-8707-466661f5faed None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.333277 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.336815 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede57a80-d30e-48c1-875e-1926122a3180 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.345333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.345957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.346231 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.346499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.376547 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.377833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.378330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.378612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.379294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:29.380187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.382074 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.393196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 99/200] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:29.394047 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.432665 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.433305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.524248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.535727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe66eb-2590-4042-8471-267c53db5f1b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.565555 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 102/201] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:29.566500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.578186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.579118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.579617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.579900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.580663 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] RBAC: Adding query filter params (role.id=628bd929b8bb42a5bfaaee51144e6445, scope.project.id=e83a91e77c5b46668ddb61809821a312, user.id=3c5ce542e6994389b1f9f8d96a5054b0) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:29.581004 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.582512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.591083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 100/202] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/role_assignments?user.id=3c5ce542e6994389b1f9f8d96a5054b0&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=628bd929b8bb42a5bfaaee51144e6445 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:29.591274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.633109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.702224 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdd037-13ca-4fff-accc-c22f0b2ec2e7 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.712368 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a762c-56f9-45d4-96f6-58801f9a26d5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.751931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.752647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.752983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.753254 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.754636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.756019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.756153 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.756760 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.757050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.757332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] PATH_INFO: `/v3/users/2c6afe4f76fb465eb7234945567e1221` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.758217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 101/203] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:29.761529 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] RBAC: Authorizing `identity:get_user(user_id=2c6afe4f76fb465eb7234945567e1221)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:29.763004 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:29.764127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.764739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 103/204] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/users/2c6afe4f76fb465eb7234945567e1221 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:29.774266 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:29.819780 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:29.891710 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f3f0f-d5a1-461a-8b18-53f4e21a4dbe None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.937072 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:29.938069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:29.938573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:29.939049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:29.973298 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea5542-6ddb-4534-9c04-e1a475c6e365 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:29.977073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:30.012655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:30.013273 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:30.013558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:30.013835 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:30.014586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=2c6afe4f76fb465eb7234945567e1221) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:30.014898 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:30.016441 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:30.023202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 102/205] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/role_assignments?user.id=2c6afe4f76fb465eb7234945567e1221&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:30.024797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:30.026506 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:30.070515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:30.152608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 104/206] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:13:30.158477 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:30.283355 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafb873-e0fd-420f-af90-ee18da42b348 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:30.319967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123638-f050-4641-98a2-a75dd4166d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:30.320605 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123638-f050-4641-98a2-a75dd4166d2d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:30.320915 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123638-f050-4641-98a2-a75dd4166d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:30.321195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123638-f050-4641-98a2-a75dd4166d2d None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:30.322333 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123638-f050-4641-98a2-a75dd4166d2d None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:30.323826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123638-f050-4641-98a2-a75dd4166d2d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:30.325525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 103/207] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:30 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:30.331393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:30.434732 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65079-77e4-49ba-b743-ae858de75aa5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:30.470716 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:30.471330 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:30.471605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:30.471874 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:30.472597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] RBAC: Adding query filter params (role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=2c6afe4f76fb465eb7234945567e1221) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:30.472932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:30.474361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1ca54-6977-4ec2-a32f-928c734cf69e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:30.476943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:30.481689 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 105/208] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:30 2022] GET /identity/v3/role_assignments?user.id=2c6afe4f76fb465eb7234945567e1221&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:31.634954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74dd3-61b3-4a42-b1c8-969aaca2235a None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:31.635943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74dd3-61b3-4a42-b1c8-969aaca2235a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:31.636425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74dd3-61b3-4a42-b1c8-969aaca2235a None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:31.638278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 104/209] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:31.643695 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc67a50-ebcf-4a5a-bce1-646b28196a76 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:31.644509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc67a50-ebcf-4a5a-bce1-646b28196a76 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:31.645017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc67a50-ebcf-4a5a-bce1-646b28196a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:31.664458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-5dc67a50-ebcf-4a5a-bce1-646b28196a76 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:31.666035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-5dc67a50-ebcf-4a5a-bce1-646b28196a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:31.736522 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 106/210] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:31.961427 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8947b0-f730-4465-ba4a-89930a021759 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:31.962068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8947b0-f730-4465-ba4a-89930a021759 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:31.962543 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8947b0-f730-4465-ba4a-89930a021759 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:31.964133 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 105/211] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:31.969568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:31.970081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:31.970545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:31.989188 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:31.990737 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:32.063888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 107/212] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:32.075402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8947b0-f730-4465-ba4a-89930a021759 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.106872 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:32.197228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8947b0-f730-4465-ba4a-89930a021759 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.233157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9f205-d3b6-4185-8076-f70def0b68eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.233716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9f205-d3b6-4185-8076-f70def0b68eb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.233996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9f205-d3b6-4185-8076-f70def0b68eb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.234271 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9f205-d3b6-4185-8076-f70def0b68eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.244900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9f205-d3b6-4185-8076-f70def0b68eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-d6b9f205-d3b6-4185-8076-f70def0b68eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:32.249636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:32.250551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:32.251369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 106/213] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:32.258249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.320931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:32.330154 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a203d52-4a05-48af-9042-c54338c83389 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.330446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a203d52-4a05-48af-9042-c54338c83389 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.330705 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a203d52-4a05-48af-9042-c54338c83389 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.332172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 107/214] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:32.339094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.339375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.339649 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.359167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:32.360364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:32.377094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1699b41-b436-4ce6-bd8b-f00dd688575d None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.425477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.426551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.427063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.427669 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.428804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:32.429376 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:32.431042 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:32.436716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 108/215] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:32.438880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.446026 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 108/216] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:32.454186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.462490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:32.566118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f95cd5-2aaf-4b18-9352-26efc6565c28 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.570873 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d74a-0f9e-4832-b9d8-3b4bf9c7607a None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.592296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:32.609585 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.609810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.610442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.610721 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.610944 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.611054 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] PATH_INFO: `/v3/users/6b3957ccc3a344f880579538730539fc` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.611472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.611909 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.613407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:32.615354 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:32.617838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 109/217] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:32.625098 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.632268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] RBAC: Authorizing `identity:get_user(user_id=6b3957ccc3a344f880579538730539fc)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:32.633868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:32.635830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 109/218] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:32 2022] GET /identity/v3/users/6b3957ccc3a344f880579538730539fc => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:32.641066 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.720320 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:32.740571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bc6b-fd81-4f42-97c3-b5475fd3277f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.744565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad68e7-d898-4562-9711-4f6d4b341d5b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.779428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06479a96-b8ad-4d83-9bb3-2e0c150c2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.780034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06479a96-b8ad-4d83-9bb3-2e0c150c2064 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.780034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06479a96-b8ad-4d83-9bb3-2e0c150c2064 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.780034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06479a96-b8ad-4d83-9bb3-2e0c150c2064 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.781302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35875e0b-a3d8-41f5-a902-accb7e7c3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.783102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06479a96-b8ad-4d83-9bb3-2e0c150c2064 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:32.783198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35875e0b-a3d8-41f5-a902-accb7e7c3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.783198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35875e0b-a3d8-41f5-a902-accb7e7c3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.783198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35875e0b-a3d8-41f5-a902-accb7e7c3fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.783433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06479a96-b8ad-4d83-9bb3-2e0c150c2064 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:32.804614 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 110/219] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:32 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:13:32.806167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac22329-b37a-41cb-92b6-e4719f65ce35 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.806480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac22329-b37a-41cb-92b6-e4719f65ce35 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.806763 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac22329-b37a-41cb-92b6-e4719f65ce35 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.808171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 111/220] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:32.808806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac22329-b37a-41cb-92b6-e4719f65ce35 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:32.845242 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:32.876831 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35875e0b-a3d8-41f5-a902-accb7e7c3fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:32.878426 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35875e0b-a3d8-41f5-a902-accb7e7c3fa3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:32.948295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac22329-b37a-41cb-92b6-e4719f65ce35 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:32.991232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:32.991951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:32.992243 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:32.992586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:32.999066 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 110/221] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:13:33.005496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:33.005685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.005888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.006186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.010977 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:33.017598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:33.020265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 112/222] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:33.021281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.033809 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:33.035499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:33.128416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 111/223] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:33.129619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.142565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:33.169340 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8d62-adef-4582-a33e-fd30db7723bf None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.217741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.218702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.220183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.220714 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.222068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:33.223691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:33.226394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 113/224] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:33.234231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.260403 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558cce-0c59-4d6f-af10-6486236a15e2 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.299861 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.300452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.300758 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.301034 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.301769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:33.301993 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:33.303573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:33.310551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:33.312592 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 112/225] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:33.321345 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.357691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e20dc7-ecb7-4324-9014-82cd763984d4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.405175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.406017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.406303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.406715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.407592 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=6b3957ccc3a344f880579538730539fc) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:33.407900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:33.409410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:33.417225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:33.418249 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 114/226] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/role_assignments?user.id=6b3957ccc3a344f880579538730539fc&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=99603dce58184be6bdfb41cb63477e74 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:33.461767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572c93-9df1-4c3d-a51a-dc68d9413b96 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.500736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.501410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.501691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.501962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] PATH_INFO: `/v3/users/2c6afe4f76fb465eb7234945567e1221` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.503302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] RBAC: Authorizing `identity:get_user(user_id=2c6afe4f76fb465eb7234945567e1221)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:33.504885 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:33.507573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 113/227] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/users/2c6afe4f76fb465eb7234945567e1221 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:33.513410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.531504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.653334 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52788e81-1cae-4754-a507-4f318f7c597b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.698211 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.698777 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.699059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.699333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.716220 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:33.723425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:33.724301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 114/228] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:33.725491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:33.727285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a944d00-813b-4b6f-8bf0-d0a80e2add8d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.730869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.778053 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:33.787280 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.788154 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.788485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.788878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.790188 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:33.791770 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:33.802001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 115/229] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:33.808217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:33.874761 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09125f09-5edb-4190-991d-47a099aa92c8 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:33.948779 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:33.950289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:33.950747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:33.951246 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:33.952087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:33.952576 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:33.954453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:33.964632 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 115/230] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:33.974172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:34.016175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d90e9-ebfd-48d1-9408-7606e26aa917 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:34.083856 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:34.084706 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:34.084998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:34.085299 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839/users/2c6afe4f76fb465eb7234945567e1221/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:34.085592 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:34.093582 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b55213482de41d888dc3c7e6d859839, user_id=2c6afe4f76fb465eb7234945567e1221, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:34.095148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:34.115197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 116/231] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:33 2022] PUT /identity/v3/projects/2b55213482de41d888dc3c7e6d859839/users/2c6afe4f76fb465eb7234945567e1221/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:13:34.157430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c18ee-2163-4fd9-b9db-7dfe3c46f6c3 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:34.206474 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:34.207058 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:34.207338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:34.207608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] PATH_INFO: `/v3/users/2c6afe4f76fb465eb7234945567e1221` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:34.208800 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6afe4f76fb465eb7234945567e1221)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:34.210367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:34.212111 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 116/232] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:33 2022] GET /identity/v3/users/2c6afe4f76fb465eb7234945567e1221 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:34.218086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:34.322307 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:34.367285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf764-48bc-45e4-a27c-cc8086a2c584 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:34.402286 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4512-1a41-4eca-81f9-89f0f583fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:34.403029 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4512-1a41-4eca-81f9-89f0f583fb91 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:34.403320 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4512-1a41-4eca-81f9-89f0f583fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:34.403603 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4512-1a41-4eca-81f9-89f0f583fb91 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:34.404779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4512-1a41-4eca-81f9-89f0f583fb91 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:34.406241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4512-1a41-4eca-81f9-89f0f583fb91 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:34.407883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 117/233] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:34 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:34.414447 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:34.534094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731cfc-cc99-47af-9c02-b8e85cbcb0a9 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:34.574017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:34.586320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68aa41-c553-4cbd-a78e-9b28348c23e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:34.586320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68aa41-c553-4cbd-a78e-9b28348c23e5 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:34.586320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68aa41-c553-4cbd-a78e-9b28348c23e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:34.586670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68aa41-c553-4cbd-a78e-9b28348c23e5 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839/users/2c6afe4f76fb465eb7234945567e1221/roles/691ab61f8d304445b4d604bb4e2ff005` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:34.589789 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68aa41-c553-4cbd-a78e-9b28348c23e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b55213482de41d888dc3c7e6d859839, user_id=2c6afe4f76fb465eb7234945567e1221, role_id=691ab61f8d304445b4d604bb4e2ff005)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:34.590276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68aa41-c553-4cbd-a78e-9b28348c23e5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:34.617299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 117/234] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:34 2022] PUT /identity/v3/projects/2b55213482de41d888dc3c7e6d859839/users/2c6afe4f76fb465eb7234945567e1221/roles/691ab61f8d304445b4d604bb4e2ff005 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:35.790336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53030916-d07a-433f-9ea2-b17ef701f609 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:35.790855 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53030916-d07a-433f-9ea2-b17ef701f609 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:35.790959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53030916-d07a-433f-9ea2-b17ef701f609 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:35.792515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 118/235] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:35.797793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d7ac-bbc4-4377-bf94-4cad95cc4cbb None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:35.798225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d7ac-bbc4-4377-bf94-4cad95cc4cbb None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:35.798400 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d7ac-bbc4-4377-bf94-4cad95cc4cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:35.822508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-fba1d7ac-bbc4-4377-bf94-4cad95cc4cbb None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:35.823740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-fba1d7ac-bbc4-4377-bf94-4cad95cc4cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:35.829193 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b52d-2585-43c5-b6b6-0ff670d4a166 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:35.829739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b52d-2585-43c5-b6b6-0ff670d4a166 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:35.830225 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b52d-2585-43c5-b6b6-0ff670d4a166 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:35.831981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 119/236] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:35.837211 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35552c3-90c2-4ea6-9c87-31453910369b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:35.837738 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35552c3-90c2-4ea6-9c87-31453910369b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:35.838210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35552c3-90c2-4ea6-9c87-31453910369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:35.877808 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-e35552c3-90c2-4ea6-9c87-31453910369b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:35.879343 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-e35552c3-90c2-4ea6-9c87-31453910369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:35.906950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 118/237] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:35.995197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 120/238] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:36.305219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2673-62c7-4f49-a259-8e6fd28f9cf6 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:36.305964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2673-62c7-4f49-a259-8e6fd28f9cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:36.306455 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2673-62c7-4f49-a259-8e6fd28f9cf6 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:36.308507 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 119/239] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:36.315207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:36.315819 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:36.316301 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:36.350851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:36.353094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:36.400476 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2673-62c7-4f49-a259-8e6fd28f9cf6 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:36.432922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:36.450680 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 121/240] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:36.509228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:36.588921 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2673-62c7-4f49-a259-8e6fd28f9cf6 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:36.613091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:36.629020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:36.630085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:36.630627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:36.631150 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:36.644059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:36.649726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:36.650659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:36.651450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:36.654297 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 120/241] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:36.661296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:36.772261 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03010-8187-4584-9722-dc44de6bb9bc None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:36.808383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd470cd-9a38-418d-9ed3-4bbc93d98c44 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:36.838536 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:36.839440 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:36.839667 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:36.840938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:36.841984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:36.842725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:36.844261 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:36.856622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 121/242] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:36.858300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:36.863255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:36.864036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:36.864432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:36.864841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:36.866142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:36.867710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:36.872789 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 122/243] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:36.874053 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:36.917327 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:36.938749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:36.985109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6c069-331d-4b56-9577-5a1560fc2a8d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:36.986903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f5f9e-42f6-4576-9209-74baedcaf3d2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.019580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.020450 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.021029 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.021546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] PATH_INFO: `/v3/users/4440ea619cea4afa8e7fed90be721912` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.024980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cca43-91a1-4f11-899d-98ae05a860fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.026266 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cca43-91a1-4f11-899d-98ae05a860fc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.026266 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cca43-91a1-4f11-899d-98ae05a860fc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.026644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cca43-91a1-4f11-899d-98ae05a860fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.039012 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] RBAC: Authorizing `identity:get_user(user_id=4440ea619cea4afa8e7fed90be721912)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.039392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cca43-91a1-4f11-899d-98ae05a860fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:37.040928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.042749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 123/244] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:36 2022] GET /identity/v3/users/4440ea619cea4afa8e7fed90be721912 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:37.043658 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-847cca43-91a1-4f11-899d-98ae05a860fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:37.045703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:37.046567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:37.047358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 122/245] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:37.048436 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502e11b-0b90-4b7f-a04c-29a2a731db3f None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.048767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502e11b-0b90-4b7f-a04c-29a2a731db3f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.049264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502e11b-0b90-4b7f-a04c-29a2a731db3f None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.051012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 123/246] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:37.051795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502e11b-0b90-4b7f-a04c-29a2a731db3f None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.157448 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad89da-7ae9-45f9-b3a1-9725e2bc10aa None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.158447 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:37.162988 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502e11b-0b90-4b7f-a04c-29a2a731db3f None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.174148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:37.198572 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.199285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.199577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.199853 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.200481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.201990 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.203603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134249d-5858-4da9-84f2-a774842fe553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.204214 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134249d-5858-4da9-84f2-a774842fe553 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.204495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134249d-5858-4da9-84f2-a774842fe553 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.204794 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134249d-5858-4da9-84f2-a774842fe553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.232727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 124/247] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:37 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:37.232727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.294664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134249d-5858-4da9-84f2-a774842fe553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.296163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134249d-5858-4da9-84f2-a774842fe553 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.371866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679ce10-5430-406a-b73c-059852948a76 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.413491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:37.417278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.417510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 124/248] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:37.418429 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.418757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.419430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.419837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.419997 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.420575 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.421603 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:37.422040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.423966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c405-5536-4828-b0ad-4c93c1aaa34c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.435448 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 125/249] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:37.440120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eac75-3f83-437e-b389-b15fcff363e5 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.440120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eac75-3f83-437e-b389-b15fcff363e5 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.440120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eac75-3f83-437e-b389-b15fcff363e5 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.440120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 126/250] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:37.441462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eac75-3f83-437e-b389-b15fcff363e5 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.441770 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:37.444361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:37.484525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:37.525082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 125/251] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:37.528794 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.580617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eac75-3f83-437e-b389-b15fcff363e5 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.624932 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1b4d-96a2-48fd-a7a3-8aba39a96f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.625714 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1b4d-96a2-48fd-a7a3-8aba39a96f50 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.625998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1b4d-96a2-48fd-a7a3-8aba39a96f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.626273 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1b4d-96a2-48fd-a7a3-8aba39a96f50 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.627479 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae1b4d-96a2-48fd-a7a3-8aba39a96f50 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.628987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae1b4d-96a2-48fd-a7a3-8aba39a96f50 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.630654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 127/252] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:37 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:37.632584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.632584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.632790 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.652083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:37.653318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:37.664323 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff38a0-2c72-49aa-a7b7-4a84b4be0fcd None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.705040 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:37.711806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.712555 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.713003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.713430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] PATH_INFO: `/v3/users/6b3957ccc3a344f880579538730539fc` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.714825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] RBAC: Authorizing `identity:get_user(user_id=6b3957ccc3a344f880579538730539fc)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.716485 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.721035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 126/253] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:37 2022] GET /identity/v3/users/6b3957ccc3a344f880579538730539fc => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:37.722035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.747983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 128/254] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:37.748982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:37.795103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:37.887055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68a15e-27bf-486d-a201-46311317fda7 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.931092 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:37.931656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:37.932038 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:37.932324 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:37.933621 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:37.935358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:37.937376 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 129/255] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:37 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:37.941070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed5f2b-8217-4d9e-97ed-6280791ba3fa None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:37.953250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.006834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.007509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.007787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.008062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.008973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] RBAC: Adding query filter params (role.id=628bd929b8bb42a5bfaaee51144e6445, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=4440ea619cea4afa8e7fed90be721912) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:38.009280 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:38.011814 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:38.032063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 127/256] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:37 2022] GET /identity/v3/role_assignments?user.id=4440ea619cea4afa8e7fed90be721912&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=628bd929b8bb42a5bfaaee51144e6445 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:38.033984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.130408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:38.186652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce9f2-ca87-4f31-983b-291913e6ada2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.230361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:38.231855 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.233256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.233697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.234120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.243019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7e5b-60c9-4f38-9c57-b7e8ad417e1e None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.248431 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:38.254962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:38.256157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:38.257596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:38.260582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 128/257] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:38.270605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.357452 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.358214 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.358414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.358691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839/users/6b3957ccc3a344f880579538730539fc/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.361166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b55213482de41d888dc3c7e6d859839, user_id=6b3957ccc3a344f880579538730539fc, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:38.362637 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:38.391865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 130/258] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:37 2022] PUT /identity/v3/projects/2b55213482de41d888dc3c7e6d859839/users/6b3957ccc3a344f880579538730539fc/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:38.392534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.408232 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0e967-7708-4311-b66d-55c3248b5722 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.438227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:38.452873 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.453923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.454360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.454782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.455847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:38.456321 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:38.458241 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:38.470061 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 129/259] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:38.488319 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.550075 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af818-8aa9-44e5-b1b2-8ffc824328b8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.591837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.592349 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.592627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.592935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.608795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:38.610806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:38.611908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:38.612979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 131/260] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:38.618523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.640614 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:38.642847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2baa-9dff-4e52-93a7-3335bcac3ba5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.691682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.692595 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.693104 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.693627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] PATH_INFO: `/v3/users/2c6afe4f76fb465eb7234945567e1221` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.695778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6afe4f76fb465eb7234945567e1221)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:38.697874 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:38.700267 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 130/261] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/users/2c6afe4f76fb465eb7234945567e1221 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:38.706311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.791930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:38.841278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703dcc-c82c-46b3-88a9-d425d2592546 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.864407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47984212-62bf-4c33-b3df-f254c0c9b247 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:38.889418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.890060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.890328 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.890609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:38.891300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:38.891606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:38.893027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:38.902248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 132/262] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:38.907659 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:38.913825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:38.914845 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:38.915476 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:38.915951 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:39.012881 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:39.015103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:39.034946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:39.081775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:39.096515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c5842-1e94-423a-bcb9-50b845aafd43 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:39.138262 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 131/263] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:13:39.147345 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:39.249674 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:39.250493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:39.250928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:39.251398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] PATH_INFO: `/v3/users/2c6afe4f76fb465eb7234945567e1221` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:39.257609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] RBAC: Authorizing `identity:get_user(user_id=2c6afe4f76fb465eb7234945567e1221)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:39.259135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:39.261070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 133/264] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:38 2022] GET /identity/v3/users/2c6afe4f76fb465eb7234945567e1221 => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:39.269750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:39.270300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4820d-2bd1-4ba7-8cab-64e5f1c5129d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:39.312872 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:39.314068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:39.314675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:39.315198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:39.316895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:39.319543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:39.321423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 132/265] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:39 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:39.334249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:39.368095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:39.496923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9be7-fe27-4350-a318-3b191b9247aa None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:39.565878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:39.566485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:39.566776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:39.567043 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:39.580580 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8583b1-4418-4273-bee6-625eaf488d83 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:39.617493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:39.658839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:39.659472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:39.659757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:39.660036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:39.660808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=2c6afe4f76fb465eb7234945567e1221) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:39.661117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:39.663089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:39.679763 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 133/266] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:39 2022] GET /identity/v3/role_assignments?user.id=2c6afe4f76fb465eb7234945567e1221&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:39.720485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:39.722152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:39.892208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 134/267] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:39.899089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:40.030416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:40.054603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4bc6-03ff-460a-bd61-1dc7a33edc92 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:40.098836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489271e-d48d-4f13-8a56-8ecf2b9fa8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:40.099908 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489271e-d48d-4f13-8a56-8ecf2b9fa8e2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.100654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489271e-d48d-4f13-8a56-8ecf2b9fa8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.101177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489271e-d48d-4f13-8a56-8ecf2b9fa8e2 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.102596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489271e-d48d-4f13-8a56-8ecf2b9fa8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:40.104239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489271e-d48d-4f13-8a56-8ecf2b9fa8e2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:40.106228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 134/268] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:39 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:40.114930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:40.181622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:40.244395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bbc4f-51cf-4f62-9e8a-8634bf28f14b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:40.284550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:40.285185 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.285465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.285746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.286475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] RBAC: Adding query filter params (role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=2c6afe4f76fb465eb7234945567e1221) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:40.286782 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:40.288328 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4428252-937e-41ae-989a-1c6f3318683f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:40.297847 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 135/269] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:40 2022] GET /identity/v3/role_assignments?user.id=2c6afe4f76fb465eb7234945567e1221&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:40.619747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26d63-5f80-45fb-8638-5d15c451d25e None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.620377 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26d63-5f80-45fb-8638-5d15c451d25e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.620876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26d63-5f80-45fb-8638-5d15c451d25e None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.622675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 135/270] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:40.628452 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebbe83-acfb-4e4a-b384-375eeb37a94d None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.628764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebbe83-acfb-4e4a-b384-375eeb37a94d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.629032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebbe83-acfb-4e4a-b384-375eeb37a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.651770 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-69ebbe83-acfb-4e4a-b384-375eeb37a94d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:40.653329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-69ebbe83-acfb-4e4a-b384-375eeb37a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:40.741002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 136/271] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:40.859672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cec66-2db0-4251-b5f4-d3a7850200cb None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.860271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cec66-2db0-4251-b5f4-d3a7850200cb None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.860768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cec66-2db0-4251-b5f4-d3a7850200cb None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.862548 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 136/272] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:40.867550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.867833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.868105 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.889681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:40.890866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:40.931978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:40.966244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced75dd-5a13-453b-989f-ab7ef690a89d None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.966572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced75dd-5a13-453b-989f-ab7ef690a89d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.966801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced75dd-5a13-453b-989f-ab7ef690a89d None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.968249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 137/273] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:40.969689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 137/274] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:40.973918 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:40.974439 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:40.975691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:40.993802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:40.995302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:41.064366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 138/275] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:41.106901 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.207631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f813d-9798-44b7-a2b5-7a2a4f15591b None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.243332 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.244031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.244314 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.244587 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.255779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:41.260774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:41.261681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:41.262465 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 138/276] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:41.269566 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.342629 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.364210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:41.385938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:41.388613 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ade80-5a9b-49ef-bdb9-d6165dd93b89 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.430501 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.431431 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.431837 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.432105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.432654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:41.432981 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:41.434370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:41.443407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 139/277] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:41.444075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.486942 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40755862-007b-42ee-9a71-e8dbd1defe23 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.546811 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.547696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.548137 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.548580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.550469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:41.552783 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:41.555538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 139/278] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:41.557104 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.581508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df2e61-a2eb-4210-aad6-12770da0acae None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.626811 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.627441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.627717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.627992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.640802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:41.646560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:41.648134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 140/279] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:41.649620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.654138 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:41.700731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:41.703293 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548af010-ffd1-4853-9186-2e5851c6179b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.742223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.742763 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.743040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.743312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] PATH_INFO: `/v3/users/5c136c56826841728557e943cbfdc8a7` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.757710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] RBAC: Authorizing `identity:get_user(user_id=5c136c56826841728557e943cbfdc8a7)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:41.759187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:41.765966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 140/280] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/users/5c136c56826841728557e943cbfdc8a7 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:41.765966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.780027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521096-1c04-404b-9293-f86be6e24204 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.817190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.817813 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.818098 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.818375 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.819546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:41.821004 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:41.845723 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 141/281] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:13:41 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:41.846566 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.876165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a88fa-11dd-4e66-bc4b-be8c90a0264a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:41.914129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:41.914908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.915496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.915784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.916467 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:41.916822 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:41.918236 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2dfe1-56e2-4006-b7b8-40d0cfaa916a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:41.927217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 141/282] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:41.929349 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947fb3-7d90-40ff-8c91-849d93ad9a13 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:41.929640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947fb3-7d90-40ff-8c91-849d93ad9a13 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:41.929922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947fb3-7d90-40ff-8c91-849d93ad9a13 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:41.931233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 142/283] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:41.934329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:41.934683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947fb3-7d90-40ff-8c91-849d93ad9a13 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:41.962071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:41.985006 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275a1dc-374e-40dd-ac45-c812fe220b72 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:42.022113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:42.022649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.022935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.023210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.023946 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, user.id=5c136c56826841728557e943cbfdc8a7, scope.system=all) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:42.024254 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:42.025749 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a556c-cdbc-4eb2-9577-db3eb9935b41 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:42.031757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 142/284] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/role_assignments?user.id=5c136c56826841728557e943cbfdc8a7&scope.system=all&role.id=99603dce58184be6bdfb41cb63477e74 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:42.033031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.033364 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.033611 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.057401 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:42.058811 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:42.062978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947fb3-7d90-40ff-8c91-849d93ad9a13 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:42.109096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:42.109878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.110013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.110755 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] PATH_INFO: `/v3/users/4440ea619cea4afa8e7fed90be721912` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.111619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=4440ea619cea4afa8e7fed90be721912)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:42.113509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:42.116282 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 143/285] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:41 2022] GET /identity/v3/users/4440ea619cea4afa8e7fed90be721912 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:42.122184 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:42.157812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 143/286] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:42.235267 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:42.250102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8593-2c7f-4e4e-b984-74144db07ab2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:42.287319 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:42.287889 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.288164 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.288434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.289610 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:42.291053 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:42.292850 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 144/287] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:42 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:42.299027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:42.373678 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:42.422915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233bd56-9c8d-41f5-b68a-dd225e867d1b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:42.470012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:42.470689 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.470965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.471242 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839/users/4440ea619cea4afa8e7fed90be721912/roles/628bd929b8bb42a5bfaaee51144e6445` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.473187 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] RBAC: Authorizing `identity:create_grant(project_id=2b55213482de41d888dc3c7e6d859839, user_id=4440ea619cea4afa8e7fed90be721912, role_id=628bd929b8bb42a5bfaaee51144e6445)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:42.474628 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:42.496331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 144/288] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:13:42 2022] PUT /identity/v3/projects/2b55213482de41d888dc3c7e6d859839/users/4440ea619cea4afa8e7fed90be721912/roles/628bd929b8bb42a5bfaaee51144e6445 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:13:42.500368 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:42.655729 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be434-b523-4074-91dd-c3a7b75e7dad None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:42.709908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:42.710960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.711470 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.711944 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.725474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:42.736718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:42.738372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:42.739961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:42.744443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 145/289] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:42.753852 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:42.869021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce31fbb-f913-4035-9fcb-2c9e03d50d4d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:42.884272 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:42.906381 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:42.907387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:42.907870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:42.908339 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:42.909239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:42.909741 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:42.911302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:42.920759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 145/290] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:42.929633 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:42.954576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:43.060624 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e2e1-ecd3-4d48-ab17-a403d177d70b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:43.114487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:43.115131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:43.115444 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:43.115717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] PATH_INFO: `/v3/users/6b3957ccc3a344f880579538730539fc` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:43.116887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] RBAC: Authorizing `identity:get_user(user_id=6b3957ccc3a344f880579538730539fc)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:43.118611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:43.120285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 146/291] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:42 2022] GET /identity/v3/users/6b3957ccc3a344f880579538730539fc => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:43.126025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:43.265471 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238a638-d27d-49c4-8694-23d59a0e4db2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:43.308356 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:43.309475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:43.309959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:43.310429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:43.381866 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:43.412959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:43.414428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:43.567248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 146/292] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:43.573382 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:43.710766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:43.735143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623c75-ae2c-4019-b20a-13c6876fcc2b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:43.794192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafb8fb-2beb-4fa8-b605-e44511827527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:43.794867 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafb8fb-2beb-4fa8-b605-e44511827527 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:43.795153 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafb8fb-2beb-4fa8-b605-e44511827527 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:43.795438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafb8fb-2beb-4fa8-b605-e44511827527 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:43.796632 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafb8fb-2beb-4fa8-b605-e44511827527 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:43.798148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafb8fb-2beb-4fa8-b605-e44511827527 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:43.800118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 147/293] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:43 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:43.806081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:43.910574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:43.941506 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953caaf-a14e-46bf-8a1c-a27e4c363a86 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:43.992465 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:43.993026 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:43.993313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:43.993649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:43.994396 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=6b3957ccc3a344f880579538730539fc) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:43.994707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:43.996173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc83ef-a49d-4ec9-ae6f-8a44bf67090f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:44.005900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 147/294] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:43 2022] GET /identity/v3/role_assignments?user.id=6b3957ccc3a344f880579538730539fc&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=99603dce58184be6bdfb41cb63477e74 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:44.641013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79200336-8d93-4f99-9dda-f376e4ed3bcd None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:44.641818 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79200336-8d93-4f99-9dda-f376e4ed3bcd None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:44.641818 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79200336-8d93-4f99-9dda-f376e4ed3bcd None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:44.643081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 148/295] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:44.649035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9cc21-49d3-4c08-8c28-58109572d586 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:44.649769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9cc21-49d3-4c08-8c28-58109572d586 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:44.649769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9cc21-49d3-4c08-8c28-58109572d586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:44.673253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-d4a9cc21-49d3-4c08-8c28-58109572d586 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:44.674467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d4a9cc21-49d3-4c08-8c28-58109572d586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:44.757697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 148/296] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:44.990204 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c66b0-6524-4dc9-8397-3215367d2a93 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:44.990917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c66b0-6524-4dc9-8397-3215367d2a93 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:44.991430 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c66b0-6524-4dc9-8397-3215367d2a93 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:44.993101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 149/297] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:44.999318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38d646-9227-4fd8-be20-9ded2e3d35de None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:44.999973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38d646-9227-4fd8-be20-9ded2e3d35de None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.000456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38d646-9227-4fd8-be20-9ded2e3d35de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.022270 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7a38d646-9227-4fd8-be20-9ded2e3d35de None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:45.023834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7a38d646-9227-4fd8-be20-9ded2e3d35de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:45.115789 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c66b0-6524-4dc9-8397-3215367d2a93 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.123875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:45.133120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 149/298] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:45.159112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0616a-bada-42b5-98ae-8436dfcc8126 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.159379 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0616a-bada-42b5-98ae-8436dfcc8126 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.159657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0616a-bada-42b5-98ae-8436dfcc8126 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.161306 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 150/299] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:45.167799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.168347 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.168837 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.194168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:45.196504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:45.274250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c66b0-6524-4dc9-8397-3215367d2a93 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:45.317164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 151/300] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:45.324589 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b136b-1dc5-4dca-b34d-7deab4290843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:45.325290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b136b-1dc5-4dca-b34d-7deab4290843 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.325574 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b136b-1dc5-4dca-b34d-7deab4290843 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.325852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b136b-1dc5-4dca-b34d-7deab4290843 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.339230 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b136b-1dc5-4dca-b34d-7deab4290843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ab1b136b-1dc5-4dca-b34d-7deab4290843 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:45.344195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:45.346034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:45.348989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 150/301] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:45.357931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.435317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161ef0-0117-4b43-8819-f84e075d67b5 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.435666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161ef0-0117-4b43-8819-f84e075d67b5 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.435909 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161ef0-0117-4b43-8819-f84e075d67b5 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.440827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 151/302] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:45.443365 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.443691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.443969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.463187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:45.464461 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:45.473209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:45.484435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8514-5f92-4fb2-b148-f71675a17163 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:45.522707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:45.531036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:45.531460 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.531737 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.532005 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.532671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:45.532999 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:45.534360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:45.544018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 152/303] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:45.544892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.545536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 152/304] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:45.554060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.703918 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6faa8-9b28-423d-8bc9-385db1e39389 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:45.712191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2f18b-ae0c-4b17-ace3-57b1d212bfe7 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:45.756101 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:45.756776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.757075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.757431 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.758547 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:45.759978 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:45.760583 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:45.761887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.761999 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 153/305] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:45.762508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.769208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.769421 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] PATH_INFO: `/v3/users/5c136c56826841728557e943cbfdc8a7` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.770758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] RBAC: Authorizing `identity:get_user(user_id=5c136c56826841728557e943cbfdc8a7)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:45.772233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:45.773876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 153/306] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:45 2022] GET /identity/v3/users/5c136c56826841728557e943cbfdc8a7 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:45.778675 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.798501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:45.852967 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:45.900369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3add03-e0d6-49d8-b327-baf1eaefc9f6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:45.908953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05111fe4-4795-473a-bfe3-67258ae5280a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:45.936764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:45.937417 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.937699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.937974 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.944784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:45.945395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:45.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:45.945968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] PATH_INFO: `/v3/groups` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:45.946592 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:45.948020 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:45.949778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:45.955078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:45.961147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 154/307] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:45.962368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:45.965428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 154/308] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Aug 18 19:13:45 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:45.966382 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.065850 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:46.116987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97a4c-306c-4bd2-a396-3cc689f3ca87 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.138308 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe2199-4b3c-4824-9636-ea717a2dd6c5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.171636 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:46.177148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.178290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.178794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.179278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.198839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:46.202979 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.203976 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:46.204339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:46.205325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:46.206109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:46.206698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.206766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 155/309] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:46.206830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] PATH_INFO: `/v3/system/users/5c136c56826841728557e943cbfdc8a7/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.206903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.207392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c136c56826841728557e943cbfdc8a7, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.208818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:46.222085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 155/310] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Aug 18 19:13:45 2022] PUT /identity/v3/system/users/5c136c56826841728557e943cbfdc8a7/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:46.222984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.366487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da9b3-78ff-41e8-9d0d-6f38dbe87c1a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.404290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:46.407934 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdee67-7de4-4b50-b170-b0ccce76c99e None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.412572 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.412809 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.413169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.413585 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.414362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:46.414735 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.416791 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:46.432490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 156/311] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:46.438628 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.464537 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.465826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.466750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.467253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.468142 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:46.468652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.471332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:46.486068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 156/312] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:46.490991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.560045 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:46.591858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc198b1-4007-4382-8339-92d1853c0ecd None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.638577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd603-7c85-40ac-ab4c-2ac511d57b5e None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.645034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.646158 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.646758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.647262 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] PATH_INFO: `/v3/users/65d79f510ec1487a969b1ef3f0a5cced` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.664668 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] RBAC: Authorizing `identity:get_user(user_id=65d79f510ec1487a969b1ef3f0a5cced)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.666657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:46.669295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 157/313] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:46 2022] GET /identity/v3/users/65d79f510ec1487a969b1ef3f0a5cced => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:46.674966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.684531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.685248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.685525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.685804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] PATH_INFO: `/v3/users/4440ea619cea4afa8e7fed90be721912` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.686989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] RBAC: Authorizing `identity:get_user(user_id=4440ea619cea4afa8e7fed90be721912)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.688498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:46.695569 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 157/314] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:46 2022] GET /identity/v3/users/4440ea619cea4afa8e7fed90be721912 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:46.697570 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:46.747039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:46.818073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110423b7-8b1e-4a1a-92f9-f64d0b427cab None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.833391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513c58-b1df-448c-8001-9ebbcaef1155 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:46.854229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:46.862609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.863620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.864141 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.864626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.866240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] RBAC: Adding query filter params (role.id=628bd929b8bb42a5bfaaee51144e6445, user.id=65d79f510ec1487a969b1ef3f0a5cced, scope.system=all) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:46.866788 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.868666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:46.876988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 158/315] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 18 19:13:46 2022] GET /identity/v3/role_assignments?user.id=65d79f510ec1487a969b1ef3f0a5cced&scope.system=all&role.id=628bd929b8bb42a5bfaaee51144e6445 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:46.885578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:46.886790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:46.887284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:46.887862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:46.983708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:46.985681 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:47.108744 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 158/316] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:47.116815 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:47.265165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d230-4ce2-48c7-8b72-de241c80df16 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:47.282223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:47.303960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96dd58-9979-4155-8699-d66bc9175c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:47.304606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dd58-9979-4155-8699-d66bc9175c0e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:47.304931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dd58-9979-4155-8699-d66bc9175c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:47.305211 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dd58-9979-4155-8699-d66bc9175c0e None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:47.306380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96dd58-9979-4155-8699-d66bc9175c0e None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:47.307844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96dd58-9979-4155-8699-d66bc9175c0e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:47.309985 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 159/317] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:47 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:47.316119 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:47.335656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:47.436552 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854471d2-6899-436e-a52e-b072cb5b6604 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:47.481769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:47.482395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:47.482684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:47.482965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:47.483780 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] RBAC: Adding query filter params (role.id=628bd929b8bb42a5bfaaee51144e6445, scope.project.id=2b55213482de41d888dc3c7e6d859839, user.id=4440ea619cea4afa8e7fed90be721912) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:47.484090 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:47.485584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd176ed3-41ac-466d-8143-657785ac4d38 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:47.492593 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 159/318] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:13:47 2022] GET /identity/v3/role_assignments?user.id=4440ea619cea4afa8e7fed90be721912&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=628bd929b8bb42a5bfaaee51144e6445 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:48.403733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb08b3-5337-4953-81f2-f4d9e78cbb61 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:48.404269 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb08b3-5337-4953-81f2-f4d9e78cbb61 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:48.404269 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb08b3-5337-4953-81f2-f4d9e78cbb61 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:48.405694 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 160/319] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:48.411436 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c85000-6103-4e66-ab44-6bbb038d1247 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:48.411968 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c85000-6103-4e66-ab44-6bbb038d1247 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:48.411968 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c85000-6103-4e66-ab44-6bbb038d1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:48.431791 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-e2c85000-6103-4e66-ab44-6bbb038d1247 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:48.433051 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-e2c85000-6103-4e66-ab44-6bbb038d1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:48.509595 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 160/320] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:48.597195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ed0f-737d-476d-9921-2d4885f8b1ac None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:48.597509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ed0f-737d-476d-9921-2d4885f8b1ac None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:48.597788 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ed0f-737d-476d-9921-2d4885f8b1ac None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:48.599370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 161/321] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:48.605824 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:48.606197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:48.606434 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:48.624446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:48.625732 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:48.628243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:48.714483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 161/322] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:48.838106 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ed0f-737d-476d-9921-2d4885f8b1ac None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:48.944535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ed0f-737d-476d-9921-2d4885f8b1ac None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:48.985590 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:48.987486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:48.987920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:48.988215 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:48.989481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:48.991488 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:48.993265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 162/323] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:48.998602 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.047375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.109293 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:49.110682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef5f4d-07fe-4ea9-83d2-02eb885a077e None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:49.154428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867de9de-34d3-4517-a659-c9dc2287726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:49.155047 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867de9de-34d3-4517-a659-c9dc2287726a None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.155331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867de9de-34d3-4517-a659-c9dc2287726a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.156041 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867de9de-34d3-4517-a659-c9dc2287726a None admin] PATH_INFO: `/v3/groups` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.156727 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867de9de-34d3-4517-a659-c9dc2287726a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:49.158293 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867de9de-34d3-4517-a659-c9dc2287726a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:49.168883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0d09e-c255-4817-bbda-0617350af0d2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:49.171639 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:49.186422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 162/324] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Aug 18 19:13:48 2022] POST /identity/v3/groups => generated 226 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:13:49.202488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866784b-b17a-4822-add7-b00962760b7e None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.202769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866784b-b17a-4822-add7-b00962760b7e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.203054 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866784b-b17a-4822-add7-b00962760b7e None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.204448 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 163/325] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:49.211011 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.211324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.211593 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.222671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:49.223153 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.223432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.223705 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.234469 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:49.235753 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:49.237971 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:49.245837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:49.247366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:49.248394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 163/326] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:49.254534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.321544 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 164/327] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:49.372416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d26d8b-bc07-4763-8957-4e3aab8004f7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:49.384522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:49.415126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:49.415741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.416012 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.416309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.417018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:49.417327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:49.418715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:49.430624 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 164/328] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:49.436369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.556258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1207d-63f0-49b9-855d-cfb4c64f5d9d None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:49.593833 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:49.594532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.594818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.595094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] PATH_INFO: `/v3/users/5c136c56826841728557e943cbfdc8a7` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.596244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] RBAC: Authorizing `identity:get_user(user_id=5c136c56826841728557e943cbfdc8a7)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:49.597711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:49.600762 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 165/329] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:49 2022] GET /identity/v3/users/5c136c56826841728557e943cbfdc8a7 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:49.601048 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:49.605906 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.651596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.750747 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a314-a488-46d2-a9b8-df2517d2dc61 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:49.797379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:49.797991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.798273 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.798544 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.799276 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] RBAC: Adding query filter params (role.id=99603dce58184be6bdfb41cb63477e74, user.id=5c136c56826841728557e943cbfdc8a7, scope.system=all) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:49.799584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:49.801077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:49.806791 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae5e2-11a9-4259-a718-dd01d26f5e1b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:49.820157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 165/330] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 18 19:13:49 2022] GET /identity/v3/role_assignments?user.id=5c136c56826841728557e943cbfdc8a7&scope.system=all&role.id=99603dce58184be6bdfb41cb63477e74 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:49.856479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:49.857563 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:49.858091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:49.858582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:49.872021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:49.878790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:49.879782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:49.880626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:49.883832 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 166/331] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:49.894006 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:49.932702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:50.026571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7da20-8ffe-49ca-a98f-83a9a3cfbfa9 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:50.069443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:50.069991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:50.070276 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:50.070554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:50.071230 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:50.071537 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:50.072978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:50.083124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 166/332] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:50.090723 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:50.165752 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:50.223130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889084-d087-42bf-8789-57fbbaaa38d7 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:50.263253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39823653-cd6d-40d2-a4e7-ec2926513cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:50.264071 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39823653-cd6d-40d2-a4e7-ec2926513cbc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:50.264460 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39823653-cd6d-40d2-a4e7-ec2926513cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:50.264866 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39823653-cd6d-40d2-a4e7-ec2926513cbc None admin] PATH_INFO: `/v3/users/65d79f510ec1487a969b1ef3f0a5cced` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:50.266418 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39823653-cd6d-40d2-a4e7-ec2926513cbc None admin] RBAC: Authorizing `identity:get_user(user_id=65d79f510ec1487a969b1ef3f0a5cced)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:50.267981 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39823653-cd6d-40d2-a4e7-ec2926513cbc None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:50.270075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 167/333] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:50 2022] GET /identity/v3/users/65d79f510ec1487a969b1ef3f0a5cced => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:50.276653 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:50.388468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:50.397890 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91dbe6-6630-415b-aeda-e89de2c2891b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:50.444049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c12a9-b7e9-40bc-ba9e-116291526ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:50.444739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c12a9-b7e9-40bc-ba9e-116291526ea0 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:50.445038 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c12a9-b7e9-40bc-ba9e-116291526ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:50.445380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c12a9-b7e9-40bc-ba9e-116291526ea0 None admin] PATH_INFO: `/v3/system/users/65d79f510ec1487a969b1ef3f0a5cced/roles/628bd929b8bb42a5bfaaee51144e6445` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:50.446847 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c12a9-b7e9-40bc-ba9e-116291526ea0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=65d79f510ec1487a969b1ef3f0a5cced, role_id=628bd929b8bb42a5bfaaee51144e6445)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:50.448241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c12a9-b7e9-40bc-ba9e-116291526ea0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:50.457799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 167/334] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Aug 18 19:13:50 2022] PUT /identity/v3/system/users/65d79f510ec1487a969b1ef3f0a5cced/roles/628bd929b8bb42a5bfaaee51144e6445 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:13:52.416855 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c668c-a15d-448c-8da8-dc9ae0b50dce None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:52.417979 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c668c-a15d-448c-8da8-dc9ae0b50dce None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:52.418479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c668c-a15d-448c-8da8-dc9ae0b50dce None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:52.420030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 168/335] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:52.426875 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:52.427433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:52.427433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:52.428475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f20b17-f8c5-4184-83a3-b203de36fcc2 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:52.429014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f20b17-f8c5-4184-83a3-b203de36fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:52.429507 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f20b17-f8c5-4184-83a3-b203de36fcc2 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:52.431253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 169/336] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:13:52.442793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789012dc-313d-4125-b1e9-123dc3d158a4 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:52.443562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789012dc-313d-4125-b1e9-123dc3d158a4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:52.444076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789012dc-313d-4125-b1e9-123dc3d158a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:52.461731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:52.462947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:52.479117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-789012dc-313d-4125-b1e9-123dc3d158a4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:52.480829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-789012dc-313d-4125-b1e9-123dc3d158a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:52.576290 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 170/337] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:52.578208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a1458-b186-4d76-b38d-8d005757f566 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:52.578731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a1458-b186-4d76-b38d-8d005757f566 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:52.579206 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a1458-b186-4d76-b38d-8d005757f566 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:52.585076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 171/338] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:52.593419 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 168/339] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:52.601115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:52.601683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:52.602158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:52.634496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:52.636059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:52.698442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:52.722303 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 172/340] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:53.118035 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.244057 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:53.264117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8144b8-f4b3-4814-80ff-5b6e3bf99c01 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:53.273128 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.329990 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:53.330648 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:53.330932 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:53.331207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:53.361646 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:53.366775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:53.367704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:53.368611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 169/341] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:53.374078 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.408172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7293-3406-47d2-8b42-c8341060135c None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:53.454318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:53.455803 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:53.456298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:53.456816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:53.468534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:53.474087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:53.475839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:53.476657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:53.479967 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 173/342] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:13:53.481087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.558372 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:53.627555 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b92da-74fc-454c-a73c-0d509df42fdc None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:53.630801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c28642-9ae8-4e16-a9bc-66ea377a9569 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:53.676239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:53.677309 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:53.678353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:53.678846 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:53.679839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:53.680385 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:53.682109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:53.691908 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 174/343] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:53.697534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.718150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:53.718811 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:53.719103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:53.719379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:53.765407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:53.770323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:53.771341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:53.772842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 170/344] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:53.773531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.790883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:53.819392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4606a-9cd1-4dd0-9462-d444616308da None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:53.827387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:53.862525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:53.863509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:53.863998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:53.864377 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:53.865228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:53.865638 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:53.867246 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:53.879501 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 175/345] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:53.880486 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:53.968374 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a979-07d7-476e-8879-654d3828bcb0 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:54.004964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891b7e-0174-408c-a2ba-ca0bf9109fae None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:54.016403 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d2fb0-3987-426d-b821-0f06adc39ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:54.017469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2fb0-3987-426d-b821-0f06adc39ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.018005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2fb0-3987-426d-b821-0f06adc39ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.018586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2fb0-3987-426d-b821-0f06adc39ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.054781 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:54.054781 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.054781 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.054781 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.055549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:54.055549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:54.055549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:54.065136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 176/346] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:54.070614 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:54.110525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:54.135806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d2fb0-3987-426d-b821-0f06adc39ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:54.137254 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d2fb0-3987-426d-b821-0f06adc39ee3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:54.146498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:54.210450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68dca3-9d32-427e-a50a-e8c3aacd7dfa None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:54.259899 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a7c70-3bf3-4e9b-9ace-ffffa2dcf8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:54.260644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7c70-3bf3-4e9b-9ace-ffffa2dcf8d3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.262351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7c70-3bf3-4e9b-9ace-ffffa2dcf8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.262628 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7c70-3bf3-4e9b-9ace-ffffa2dcf8d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.276983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 171/347] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:54.278627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ad2f3-3aa1-48f8-b267-707ba57c1ea4 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.278944 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ad2f3-3aa1-48f8-b267-707ba57c1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.279475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ad2f3-3aa1-48f8-b267-707ba57c1ea4 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.280785 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 172/348] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:54.284739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ad2f3-3aa1-48f8-b267-707ba57c1ea4 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:54.354739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a7c70-3bf3-4e9b-9ace-ffffa2dcf8d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:54.356794 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a7c70-3bf3-4e9b-9ace-ffffa2dcf8d3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:54.403573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:54.429442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ad2f3-3aa1-48f8-b267-707ba57c1ea4 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:54.439260 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:54.473261 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e4f56-21f9-4f56-afa1-7ad2fbb6a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:54.473773 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4f56-21f9-4f56-afa1-7ad2fbb6a74c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.474060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4f56-21f9-4f56-afa1-7ad2fbb6a74c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.474338 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4f56-21f9-4f56-afa1-7ad2fbb6a74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.496294 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 177/349] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:54.500814 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed269b-8dc7-4f4c-816b-85c013f024b9 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.501067 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed269b-8dc7-4f4c-816b-85c013f024b9 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.501362 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed269b-8dc7-4f4c-816b-85c013f024b9 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.502832 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 178/350] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:54.503849 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed269b-8dc7-4f4c-816b-85c013f024b9 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:54.561421 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e4f56-21f9-4f56-afa1-7ad2fbb6a74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:54.562951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e4f56-21f9-4f56-afa1-7ad2fbb6a74c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:54.652517 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed269b-8dc7-4f4c-816b-85c013f024b9 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:54.691472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 173/351] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:54.692669 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da98e-2425-43a6-b837-e0c827b6c29e None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.695117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da98e-2425-43a6-b837-e0c827b6c29e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.695117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da98e-2425-43a6-b837-e0c827b6c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.697879 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:54.704751 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:54.705407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.706132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.706132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.707084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:54.708531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:54.713763 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 179/352] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:54 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:54.713763 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:54.714042 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:54.718939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-a95da98e-2425-43a6-b837-e0c827b6c29e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:54.720141 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-a95da98e-2425-43a6-b837-e0c827b6c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:54.807254 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 174/353] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:54.808542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.808896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.809177 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.831814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:54.833799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:54.847755 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0da98-940c-445c-9176-e41b25b2a7ed None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:54.902613 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc9bb4-d461-4a9e-9283-df28b5f3cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:54.903373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc9bb4-d461-4a9e-9283-df28b5f3cb7c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.903664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc9bb4-d461-4a9e-9283-df28b5f3cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.903947 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc9bb4-d461-4a9e-9283-df28b5f3cb7c None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.905127 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc9bb4-d461-4a9e-9283-df28b5f3cb7c None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:54.906704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc9bb4-d461-4a9e-9283-df28b5f3cb7c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:54.909118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 180/354] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:54 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:54.909812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd81cb-70a3-4832-8235-6ac2d064ee58 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:54.910103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd81cb-70a3-4832-8235-6ac2d064ee58 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:54.910419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd81cb-70a3-4832-8235-6ac2d064ee58 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:54.912720 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 181/355] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:54.913597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd81cb-70a3-4832-8235-6ac2d064ee58 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:54.937446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 175/356] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:54.941337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.008919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.026702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.058502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd81cb-70a3-4832-8235-6ac2d064ee58 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.083135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d0763-0d0a-4dcd-a71e-57625801e076 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.111791 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.112919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.113987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.114482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.116014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.117847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.120179 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 182/357] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:54 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.121357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.155204 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85019-17cf-4b24-b76b-ac853e2bfb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.156034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85019-17cf-4b24-b76b-ac853e2bfb96 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.156324 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85019-17cf-4b24-b76b-ac853e2bfb96 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.156604 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85019-17cf-4b24-b76b-ac853e2bfb96 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.166241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85019-17cf-4b24-b76b-ac853e2bfb96 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.167745 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85019-17cf-4b24-b76b-ac853e2bfb96 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.170718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 176/358] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:13:54 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.171921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.172209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.172489 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.195434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:55.196940 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:55.249486 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154f86f-d153-4027-9900-b77b0bb8ccd0 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.296010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 177/359] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:55.296760 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.298272 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.299120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.299882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.301205 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.301708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.303879 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.307248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 183/360] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.308224 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.316336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.370976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.417407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f1b06-d4fb-46d6-9069-0aeddeef5e3b None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.446929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199becc-fc89-4ec5-a5a8-78b37723d8be None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.472598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.473594 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.474032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.475001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.476549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.478190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.479931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 178/361] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.480885 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.488656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.489321 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.489605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.490078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.491399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=e83a91e77c5b46668ddb61809821a312) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:55.491972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.493171 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.499134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 184/362] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=99603dce58184be6bdfb41cb63477e74 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.500250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.577585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.600546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1084f-6aa6-455b-b123-6b358968157a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.622551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a9dcf-0df2-4678-bc05-dbc0eed938d4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.635177 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.644853 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.645896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.646526 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.647021 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.660411 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:55.663331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.663992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.664277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.664555 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:55.668202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:55.669166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:13:55.669968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:55.672984 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 179/363] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:55.675612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.677294 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:55.684020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:55.685063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:13:55.685876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 185/364] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:55.686582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.813712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe182d3-f898-428a-bcb4-53dbf5b8c8c1 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.840335 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b99e16-53fa-4d6f-864c-e0572edac80f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:55.868534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.869213 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.869501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.869779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.870726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=2b55213482de41d888dc3c7e6d859839) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:55.871041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.872486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.877460 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:55.880055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 180/365] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=99603dce58184be6bdfb41cb63477e74 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.881651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.891385 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:55.892270 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:55.892782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:55.893273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:55.894219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=e83a91e77c5b46668ddb61809821a312) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:55.894532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:55.896017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:55.914147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 186/366] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:55.915219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:55.963022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.083391 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbfb4e-9a0f-401b-81ba-08c617b32ffb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.131635 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b6f1-4209-45a2-af24-cd9887b06a08 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.153385 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.154107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.154283 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.154554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.155249 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:56.155553 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.157091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.171204 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 181/367] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:56.172114 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.184269 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.185757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.186461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.187094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.188235 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:56.188882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.193113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.205259 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 187/368] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:56.206924 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.276532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.306241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326839fe-f18d-40bf-a32e-551cb468deec None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.321694 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.341339 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d75d51-785e-4daa-a0b7-d19e0a3dba7a None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.348336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.349007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.349297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.350106 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.361993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:56.368036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:56.369007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:56.370073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 182/369] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:56.370977 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.388499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.389489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.390073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.390605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.500114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.502259 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.509926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869758bb-e830-4d36-9bfd-c8c8a897ed57 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.558655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.559935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.560423 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.561196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] PATH_INFO: `/v3/users/65d79f510ec1487a969b1ef3f0a5cced` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.562983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] RBAC: Authorizing `identity:get_user(user_id=65d79f510ec1487a969b1ef3f0a5cced)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.565051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.565520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.567661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 183/370] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/users/65d79f510ec1487a969b1ef3f0a5cced => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:56.568759 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.625498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.632157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 188/371] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:56.633573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.694802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b40098-8e0e-43b6-bac8-dfed9f47b734 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.736903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.737523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.737802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.738074 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.738738 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:56.739179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.740613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.749747 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 184/372] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:56.750577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.767913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c356-7745-4647-85fb-9ae9935b3f81 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.811888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.812838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.813318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.813761 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.814683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] RBAC: Adding query filter params (role.id=628bd929b8bb42a5bfaaee51144e6445, user.id=65d79f510ec1487a969b1ef3f0a5cced, scope.system=all) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:56.815204 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.816859 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.830094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 189/373] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/role_assignments?user.id=65d79f510ec1487a969b1ef3f0a5cced&scope.system=all&role.id=628bd929b8bb42a5bfaaee51144e6445 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:56.831255 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.845023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.882033 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80bf62-37b3-498a-aeab-ad5a18e09e24 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.888529 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:56.946367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.947401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.947877 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.948343 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:56.953159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:56.955036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:56.957598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 185/374] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:56.960290 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3851c5-984d-4acd-92d5-39c7f8b3eb2d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:56.964782 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:56.998683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:56.999309 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:56.999613 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:56.999876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:57.077395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:57.082462 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:57.096568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:57.124914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd9a3-f39d-4492-a07e-9f292badecda None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:57.175385 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:57.176398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:57.177689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:57.178572 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:57.181103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:57.184032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:57.190512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 186/375] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:57.210622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:57.246708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 190/376] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:13:57.255116 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:57.323967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:57.417646 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6915ab7-424f-431e-ad73-e20036d81279 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:57.480089 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:57.481062 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:57.481531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:57.481933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:57.483202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=2b55213482de41d888dc3c7e6d859839) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:57.483721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:57.485443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:57.491825 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 187/377] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:13:57 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:13:57.558963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68755-02a4-4416-a782-6d3d89a95836 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:57.589149 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:57.676179 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:57.676869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:57.677144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:57.677420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] PATH_INFO: `/v3/projects/8b376485ea1c4cabaaa338eee652b199` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:57.679245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] RBAC: Authorizing `identity:get_project(project_id=8b376485ea1c4cabaaa338eee652b199)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:57.680928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:57.682842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 191/378] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:57 2022] GET /identity/v3/projects/8b376485ea1c4cabaaa338eee652b199 => generated 344 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:57.688998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:57.845761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37d5f9-8c23-4af9-8d1c-781d4f7dbb88 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:57.848808 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:57.885174 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b8d69-8010-47d8-8b83-794c41e95e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:57.885857 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b8d69-8010-47d8-8b83-794c41e95e78 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:57.886081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b8d69-8010-47d8-8b83-794c41e95e78 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:57.886767 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b8d69-8010-47d8-8b83-794c41e95e78 None admin] PATH_INFO: `/v3/groups/008d4a53a0b548619b3a457e5106a896` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:57.903577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b8d69-8010-47d8-8b83-794c41e95e78 None admin] RBAC: Authorizing `identity:get_group(group_id=008d4a53a0b548619b3a457e5106a896)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:57.905096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b8d69-8010-47d8-8b83-794c41e95e78 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:57.907099 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 188/379] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:13:57 2022] GET /identity/v3/groups/008d4a53a0b548619b3a457e5106a896 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:57.916573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:58.066382 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e858d-2850-4b9a-9aab-b7f8aa737524 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:58.113528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:58.114090 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:58.114380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:58.114652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:58.115985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] RBAC: Adding query filter params (group.id=008d4a53a0b548619b3a457e5106a896, role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=8b376485ea1c4cabaaa338eee652b199) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:58.116297 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:58.117759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfc60-dad9-4683-bf40-5a1c6858a66f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:58.123816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 192/380] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:13:57 2022] GET /identity/v3/role_assignments?group.id=008d4a53a0b548619b3a457e5106a896&scope.project.id=8b376485ea1c4cabaaa338eee652b199&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:58.566220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1327a4-6f7c-4cec-9709-a75bc67f7d18 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:58.566533 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1327a4-6f7c-4cec-9709-a75bc67f7d18 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:58.566711 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1327a4-6f7c-4cec-9709-a75bc67f7d18 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:58.568861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 189/381] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:58.593961 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883e1a7-d25f-4247-8adb-aa18756f636c None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:58.594421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883e1a7-d25f-4247-8adb-aa18756f636c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:58.594583 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883e1a7-d25f-4247-8adb-aa18756f636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:58.621743 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-a883e1a7-d25f-4247-8adb-aa18756f636c None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:58.622977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-a883e1a7-d25f-4247-8adb-aa18756f636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:58.667946 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:58.710371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 193/382] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:59.106538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1327a4-6f7c-4cec-9709-a75bc67f7d18 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:59.232080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5110f-d236-4f3e-afe7-63ffa49841a3 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.232469 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5110f-d236-4f3e-afe7-63ffa49841a3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.232725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5110f-d236-4f3e-afe7-63ffa49841a3 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.235386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 194/383] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:59.242452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692611-9a78-4665-aa83-544170d17f43 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.242736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692611-9a78-4665-aa83-544170d17f43 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.243014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692611-9a78-4665-aa83-544170d17f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.247635 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1327a4-6f7c-4cec-9709-a75bc67f7d18 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:59.282669 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-95692611-9a78-4665-aa83-544170d17f43 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:59.283875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-95692611-9a78-4665-aa83-544170d17f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:59.306143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:59.306789 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.307073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.307347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.328208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:13:59.333505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:13:59.334486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:13:59.335278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 190/384] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:13:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:13:59.346501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:59.407505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:59.435020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 195/385] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:13:59.501219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183e3ce-8d25-4c5a-917a-7050a4293f59 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:59.535687 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:59.536336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.536624 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.537461 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.538129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:13:59.538432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:59.539812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad82b3-f201-4056-a39c-cd4f388bfbaa None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:59.548888 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 191/386] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:59.557799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692611-9a78-4665-aa83-544170d17f43 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:59.644332 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2eff-0919-47f4-b57b-08896a40b7f2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.644332 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2eff-0919-47f4-b57b-08896a40b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.644332 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2eff-0919-47f4-b57b-08896a40b7f2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.645048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 192/387] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:13:59.660484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.660780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.660994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.689375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:13:59.693564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:13:59.716365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692611-9a78-4665-aa83-544170d17f43 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:13:59.718088 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:59.780562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 193/388] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:13:59.796059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:13:59.796720 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:13:59.797003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:13:59.797273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:13:59.801304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:13:59.803276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:13:59.805199 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 196/389] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:13:59 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:13:59.810910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:59.838573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:13:59.843689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:13:59.995873 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef169bd2-1466-4c52-a7b8-6148211e3aec None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.021241 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced837-a8c1-4faf-8599-ff5ea97a2152 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.069498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.070142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.070421 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.070694 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.072587 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:00.074058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:00.075859 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 194/390] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:13:59 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:00.087348 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.109009 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.109676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.109958 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.110233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.135737 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:00.141161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:00.142080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:00.142916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:00.144861 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 197/391] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:00.154680 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.192778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:00.210867 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358631f-2761-479e-93b9-80664f8eb2e2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.221257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:00.264530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.265784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.266270 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.266743 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312/groups/58ce052280b746478c4d890f54ab2d97/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.269535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83a91e77c5b46668ddb61809821a312, group_id=58ce052280b746478c4d890f54ab2d97, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:00.271904 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:00.288390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 195/392] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 18 19:14:00 2022] PUT /identity/v3/projects/e83a91e77c5b46668ddb61809821a312/groups/58ce052280b746478c4d890f54ab2d97/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:00.289772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.358347 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47926e97-c1a0-4252-81ba-05001df35cea None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.442853 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.442853 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.443380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.443592 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.444318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:00.444627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:00.446150 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a076-93ae-4bc3-81e0-f6ccad59b224 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:00.456401 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 198/393] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:00.458107 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806ec8-e031-4cd7-8aad-fcc4eb4729e9 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.458396 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806ec8-e031-4cd7-8aad-fcc4eb4729e9 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.459229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806ec8-e031-4cd7-8aad-fcc4eb4729e9 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.465128 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 199/394] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:00.466445 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806ec8-e031-4cd7-8aad-fcc4eb4729e9 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.476820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f6af-2f28-4954-9ece-880aa1044b31 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.521179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d8dc5-673f-4551-acb0-ac17a1859ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.522912 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d8dc5-673f-4551-acb0-ac17a1859ae4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.523406 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d8dc5-673f-4551-acb0-ac17a1859ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.523958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d8dc5-673f-4551-acb0-ac17a1859ae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.538816 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d8dc5-673f-4551-acb0-ac17a1859ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-a05d8dc5-673f-4551-acb0-ac17a1859ae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:00.545841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:00.546829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:14:00.547627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:00.549782 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 196/395] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:00.555014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.555014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.555014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.573685 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:00.574962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:00.577407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:00.643136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:00.653969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806ec8-e031-4cd7-8aad-fcc4eb4729e9 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.659531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 197/396] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:00.660426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.700736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115c84a-84ac-40d9-ac76-2bd6b9e4a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.702370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c84a-84ac-40d9-ac76-2bd6b9e4a7fb None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.702999 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c84a-84ac-40d9-ac76-2bd6b9e4a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.703575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c84a-84ac-40d9-ac76-2bd6b9e4a7fb None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.705148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115c84a-84ac-40d9-ac76-2bd6b9e4a7fb None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:00.707526 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115c84a-84ac-40d9-ac76-2bd6b9e4a7fb None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:00.710741 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 200/397] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:00 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:00.713073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfcf59-1571-4e2c-b134-54791d48fbfa None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.713568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfcf59-1571-4e2c-b134-54791d48fbfa None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.713997 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfcf59-1571-4e2c-b134-54791d48fbfa None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.715897 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 201/398] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:00.716830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfcf59-1571-4e2c-b134-54791d48fbfa None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.798127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0e654-bf58-4ff1-ad82-604581d725e6 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.837299 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.837845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.838200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.838545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.839291 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] RBAC: Adding query filter params (name=member) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:00.839900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:00.841215 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc3c8f-9a95-458d-8bbf-f13adcc4629a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:00.847606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:00.852490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 198/399] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:00.853885 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.854526 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.854866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.873742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:00.874596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfcf59-1571-4e2c-b134-54791d48fbfa None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:00.875079 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:00.920725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:00.921549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:00.921904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:00.922249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:00.923627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:00.925243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:00.932066 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 202/400] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:00 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:00.933096 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:00.964510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:00.966321 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 199/401] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:00.967478 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.077739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3de1bc-5478-49d9-9c60-d0dad8c3d192 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.085924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bea9c9-950e-4d3d-97df-9d256b6c0494 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.128889 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.129881 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.130346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.131385 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.131492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:01.133036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:01.134808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:01.136876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 203/402] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:00 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:01.137909 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.144903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.146926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.147487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.147997 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312/groups/58ce052280b746478c4d890f54ab2d97/roles/691ab61f8d304445b4d604bb4e2ff005` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.150712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83a91e77c5b46668ddb61809821a312, group_id=58ce052280b746478c4d890f54ab2d97, role_id=691ab61f8d304445b4d604bb4e2ff005)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:01.154933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:01.185427 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 200/403] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 18 19:14:00 2022] PUT /identity/v3/projects/e83a91e77c5b46668ddb61809821a312/groups/58ce052280b746478c4d890f54ab2d97/roles/691ab61f8d304445b4d604bb4e2ff005 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:01.189399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.278314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:01.286939 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92a3d1-a264-4661-a8d1-ba1892c11e05 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.335273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.336370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.336903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.337399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.353736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:01.359969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:01.360994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:01.361900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:01.364872 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 204/404] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:01.373807 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.411073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0db3-ad75-4d51-acb2-bd2fbe753735 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.467782 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.468457 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.468760 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.469029 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.471608 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:01.473203 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:01.475255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 201/405] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:01.476310 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.533113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4ce2-5ebc-40fe-bf80-2ff112e7b3de None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.552724 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:01.595901 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.597047 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.597481 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.597921 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.599018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:01.600018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:01.602158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:01.619608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 205/406] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:01.619608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.624002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eeafe-1127-4f97-aaa2-783096d379e2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.647438 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:01.669357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.670792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.670792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.670792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.683077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:01.688846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:01.689733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:01.690551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 202/407] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:01.691212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.759136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c34d-b696-4ac5-8c2d-4072b6450021 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.803899 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.805223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.805659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.806083 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839/groups/58ce052280b746478c4d890f54ab2d97/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.808837 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=2b55213482de41d888dc3c7e6d859839, group_id=58ce052280b746478c4d890f54ab2d97, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:01.810484 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:01.825639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54e4c-34e2-48d0-a7b4-f9f5c798cb17 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:01.840717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 206/408] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 18 19:14:01 2022] PUT /identity/v3/projects/2b55213482de41d888dc3c7e6d859839/groups/58ce052280b746478c4d890f54ab2d97/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:01.840717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:01.868778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:01.906938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:01.907597 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:01.907880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:01.908159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:01.912641 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:01.914183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:01.915893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 203/409] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:01.926436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:02.018155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:02.080974 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299cd3d-8d17-4cbf-bf82-79b37b0d8bfa None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:02.096367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f898c-c6f2-4d4e-8057-fde1d25d8ee5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:02.137033 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:02.138200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.138882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.139300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.140631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:02.141220 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:02.143129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:02.145315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:02.146068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.147361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.147758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.149044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:02.151058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:02.153444 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 204/410] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:02.154672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 207/411] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:02.159141 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:02.160425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:02.268303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:02.342881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72233-5004-4f6a-b3ed-7877a4fd5765 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:02.388090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:02.389327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.390143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.391935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64bd4-1a5c-4ffd-9c33-cc6e1ceebd88 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:02.392427 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839/groups/58ce052280b746478c4d890f54ab2d97/roles/691ab61f8d304445b4d604bb4e2ff005` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.398295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b55213482de41d888dc3c7e6d859839, group_id=58ce052280b746478c4d890f54ab2d97, role_id=691ab61f8d304445b4d604bb4e2ff005)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:02.400093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:02.421914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 205/412] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 18 19:14:02 2022] PUT /identity/v3/projects/2b55213482de41d888dc3c7e6d859839/groups/58ce052280b746478c4d890f54ab2d97/roles/691ab61f8d304445b4d604bb4e2ff005 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:14:02.457671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:02.458776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.459381 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.459857 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] PATH_INFO: `/v3/groups/008d4a53a0b548619b3a457e5106a896` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.461514 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] RBAC: Authorizing `identity:get_group(group_id=008d4a53a0b548619b3a457e5106a896)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:02.463365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:02.465539 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 208/413] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:02 2022] GET /identity/v3/groups/008d4a53a0b548619b3a457e5106a896 => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:02.471162 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:02.595833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee2d59-ee90-4593-b782-86183ad2eac7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:02.612527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:02.649946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ace9-fc96-4406-8167-8f3de8b1eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:02.650526 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ace9-fc96-4406-8167-8f3de8b1eb29 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.650809 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ace9-fc96-4406-8167-8f3de8b1eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.651088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ace9-fc96-4406-8167-8f3de8b1eb29 None admin] PATH_INFO: `/v3/projects/8b376485ea1c4cabaaa338eee652b199` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.652297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8ace9-fc96-4406-8167-8f3de8b1eb29 None admin] RBAC: Authorizing `identity:get_project(project_id=8b376485ea1c4cabaaa338eee652b199)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:02.653801 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8ace9-fc96-4406-8167-8f3de8b1eb29 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:02.655569 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 206/414] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:02 2022] GET /identity/v3/projects/8b376485ea1c4cabaaa338eee652b199 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:02.662689 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:02.677080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:02.782015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb79e-3cfd-483f-82aa-826fb0eff180 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:02.824174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159119c-9dbe-4324-aab1-2f0b9cd00d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:02.824893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159119c-9dbe-4324-aab1-2f0b9cd00d2b None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.825177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159119c-9dbe-4324-aab1-2f0b9cd00d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.825543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159119c-9dbe-4324-aab1-2f0b9cd00d2b None admin] PATH_INFO: `/v3/projects/8b376485ea1c4cabaaa338eee652b199/groups/008d4a53a0b548619b3a457e5106a896/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.828221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159119c-9dbe-4324-aab1-2f0b9cd00d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=8b376485ea1c4cabaaa338eee652b199, group_id=008d4a53a0b548619b3a457e5106a896, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:02.829694 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159119c-9dbe-4324-aab1-2f0b9cd00d2b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:02.844641 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 209/415] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 18 19:14:02 2022] PUT /identity/v3/projects/8b376485ea1c4cabaaa338eee652b199/groups/008d4a53a0b548619b3a457e5106a896/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:02.978326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864392a7-9cc8-42bd-a9f1-a9834a3e5883 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.978518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864392a7-9cc8-42bd-a9f1-a9834a3e5883 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.978794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864392a7-9cc8-42bd-a9f1-a9834a3e5883 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:02.980356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 207/416] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:02.989218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:02.989502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:02.989766 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:03.017859 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:03.019212 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:03.110906 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:03.120041 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 210/417] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:03.629123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864392a7-9cc8-42bd-a9f1-a9834a3e5883 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:03.777764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864392a7-9cc8-42bd-a9f1-a9834a3e5883 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:03.829385 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e086b4-5fa5-4772-b511-3001f3fb93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:03.830487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e086b4-5fa5-4772-b511-3001f3fb93c1 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:03.830964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e086b4-5fa5-4772-b511-3001f3fb93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:03.831460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e086b4-5fa5-4772-b511-3001f3fb93c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:03.848430 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e086b4-5fa5-4772-b511-3001f3fb93c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-e7e086b4-5fa5-4772-b511-3001f3fb93c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:03.854339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:03.855209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:14:03.856000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:03.858621 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 208/418] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:03.863972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:03.915262 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da338-d71a-4906-a9be-b57d60230bb6 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:03.915888 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da338-d71a-4906-a9be-b57d60230bb6 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:03.916378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da338-d71a-4906-a9be-b57d60230bb6 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:03.918202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 209/419] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:03.925977 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:03.926523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:03.926992 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:03.946176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:03.947821 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:03.995209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:04.032628 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fe951-2dbc-4f1e-b92d-e4f31f4f7af3 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:04.058726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 210/420] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:04.081401 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:04.082032 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:04.082409 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:04.082753 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:04.083492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:04.084374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:04.085966 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd55ef-057c-4d6f-bfec-50713e1b5b2a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:04.095307 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 211/421] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:14:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:04.102176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:04.234536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcb30c-ffb9-428c-bec0-697bf83e01e4 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:04.286920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:04.287943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:04.288437 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:04.288938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:04.344055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:04.372872 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:04.374295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:04.463039 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658fe8-8cfb-47d3-9141-8b508b465e5e None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:04.463359 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658fe8-8cfb-47d3-9141-8b508b465e5e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:04.463596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658fe8-8cfb-47d3-9141-8b508b465e5e None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:04.464928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 212/422] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:04.481922 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:04.482204 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:04.482477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:04.493459 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 211/423] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:04.494314 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:04.510078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:04.511315 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:04.574337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:04.598018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:04.620087 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbb6c-46fc-4d73-820d-9aa39d6d1c57 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:04.626584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 213/424] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:04.627708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:04.721471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:04.722151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:04.722401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:04.722677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:04.742510 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:04.755326 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deadf8-082c-4f98-bfed-cd6fdbc16193 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:04.755965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:04.756896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:04.762567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 212/425] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:04.776553 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:04.803852 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:04.804941 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:04.805418 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:04.805936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:04.807333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:04.808976 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:04.810905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 214/426] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:04 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:04.818338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:04.909223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:04.926945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1f46c-aa9a-439a-a8e8-a905bbeb7ab4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:04.958551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ce047-d7ee-42c3-9f24-060d44d9713d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:04.981388 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:04.999425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.000414 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.000999 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.001547 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.003031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.004860 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.006801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 215/427] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:04 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:05.007832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.008675 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.009207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.009667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.010532 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:05.011035 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.012394 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.016346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.034025 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 213/428] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:05.039903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.186728 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faee4b-6ca5-484b-9855-e6bf23b7d6d5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:05.208370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f83baf-45ba-4fe6-92ab-8c173d829e80 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:05.218527 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:05.230240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.231221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.231700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.232212 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.233172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=e83a91e77c5b46668ddb61809821a312) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:05.233760 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.235416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.243148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 216/429] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=99603dce58184be6bdfb41cb63477e74 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:05.244306 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.249634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f048a-5e83-4309-950e-c043f67b858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.249634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f048a-5e83-4309-950e-c043f67b858a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.249903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f048a-5e83-4309-950e-c043f67b858a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.250219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f048a-5e83-4309-950e-c043f67b858a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.360015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8f87-d411-4996-9507-6ca2b18cc8ce None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:05.370335 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:05.382024 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f048a-5e83-4309-950e-c043f67b858a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.383692 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f048a-5e83-4309-950e-c043f67b858a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.400504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a56c-9f2c-4b52-a70d-8d1233b24e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.401842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a56c-9f2c-4b52-a70d-8d1233b24e08 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.402330 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a56c-9f2c-4b52-a70d-8d1233b24e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.403076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a56c-9f2c-4b52-a70d-8d1233b24e08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.415707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1a56c-9f2c-4b52-a70d-8d1233b24e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-e0f1a56c-9f2c-4b52-a70d-8d1233b24e08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:05.422190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:05.423578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:14:05.424586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:05.426648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 217/430] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:05.428661 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2462-ee88-4ac6-8742-c04bb3470d9f None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.428992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2462-ee88-4ac6-8742-c04bb3470d9f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.429268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2462-ee88-4ac6-8742-c04bb3470d9f None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.434889 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 218/431] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:05.435845 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2462-ee88-4ac6-8742-c04bb3470d9f None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.511318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:05.527438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 214/432] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:05.530093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.530388 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.530660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.550336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:05.551531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:05.594377 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2462-ee88-4ac6-8742-c04bb3470d9f None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:05.640590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.641245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 215/433] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:05.641357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.642253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.642253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.642437 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.642520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] RBAC: Adding query filter params (name=member) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:05.642788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.654050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 219/434] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:05.660926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.670730 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:05.788497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa370af3-6b06-4047-bee5-97b510445043 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:05.793692 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aafe8-a2be-4d4d-ae1a-ca64710a5999 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:05.814491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:05.842532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.843105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.843382 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.846059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.846175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed442162-60bd-4938-ab29-7873d5e87925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:05.846175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed442162-60bd-4938-ab29-7873d5e87925 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.846175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed442162-60bd-4938-ab29-7873d5e87925 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.846175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed442162-60bd-4938-ab29-7873d5e87925 None admin] PATH_INFO: `/v3/projects/e83a91e77c5b46668ddb61809821a312` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.849040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed442162-60bd-4938-ab29-7873d5e87925 None admin] RBAC: Authorizing `identity:get_project(project_id=e83a91e77c5b46668ddb61809821a312)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.849040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed442162-60bd-4938-ab29-7873d5e87925 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.851971 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 216/435] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/projects/e83a91e77c5b46668ddb61809821a312 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:05.853254 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735eda0d-d2d1-4bfd-8953-e462ecd5beb2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:05.853535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735eda0d-d2d1-4bfd-8953-e462ecd5beb2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:05.853806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735eda0d-d2d1-4bfd-8953-e462ecd5beb2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:05.855319 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 217/436] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:05.856836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735eda0d-d2d1-4bfd-8953-e462ecd5beb2 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:05.923444 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:05.925060 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:05.971443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:05.984204 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735eda0d-d2d1-4bfd-8953-e462ecd5beb2 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.021176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b8234-4795-4814-b02e-10ca0fa4e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.021814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8234-4795-4814-b02e-10ca0fa4e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.022106 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8234-4795-4814-b02e-10ca0fa4e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.022380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8234-4795-4814-b02e-10ca0fa4e1b8 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.023570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b8234-4795-4814-b02e-10ca0fa4e1b8 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.024956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b8234-4795-4814-b02e-10ca0fa4e1b8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.026601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 218/437] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:06.027710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.027991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.028262 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.029566 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 220/438] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:14:06.030238 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.045235 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.051037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:06.052215 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:06.120390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 219/439] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:06.121093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.136427 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4757a-8a53-4aa7-828c-1d768c1bebfb None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.179593 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.180350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.180638 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.181105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.196247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:06.202081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:06.202980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:14:06.203804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:06.205245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 221/440] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:06.205245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.217152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.231625 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72279dc-2c02-43bf-b7f9-53ef5e2f6a3f None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.268411 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.269069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.269345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.269616 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.270454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=e83a91e77c5b46668ddb61809821a312) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:06.270869 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.272347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.288717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 220/441] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=e83a91e77c5b46668ddb61809821a312&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:06.288717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.292819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.327733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d28a-7d15-4a5f-8320-a9a55c92e326 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.367643 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.368293 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.368578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.368893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.371064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.372547 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.374339 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 222/442] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:06.381573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.426518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c5d5-81ea-4742-a573-c8b2397f2ea3 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.470958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.471583 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.471862 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.472135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.472852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:06.473156 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.475954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.487244 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 221/443] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:06.487693 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.502795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfd7c2-e430-419c-b82f-6cdff40d8ea1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.509030 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.545938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.546387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.546681 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.546961 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.548111 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.549606 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.551186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 223/444] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:06.557639 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.569505 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.628828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b410-a7a4-44f8-a776-9c64ea2efa5f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.670047 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.670697 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.670980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.671647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.685852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:06.686954 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8dc3-ef6e-4145-bb87-db5525571594 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:06.691032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:06.691947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:06.692844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 222/445] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:06.694086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.731227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.731965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.732316 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.732585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.775035 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.802171 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.802494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18255142-a7aa-49c0-880b-8bcc025372e2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:06.804288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.815351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:06.843222 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:06.843737 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:06.844018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:06.844288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:06.845039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=99603dce58184be6bdfb41cb63477e74, scope.project.id=2b55213482de41d888dc3c7e6d859839) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:06.845345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:06.846792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:06.853280 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 223/446] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=99603dce58184be6bdfb41cb63477e74 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:06.854049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.919984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 224/447] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:06.925998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:06.979527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e850-8484-4513-a64e-834acedd81c0 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.026172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.026794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.027080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.027359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.028029 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:07.028335 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.029768 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.040511 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 224/448] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:07.046267 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:07.049454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:07.060780 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690c02a-8ecc-414b-a8c9-f090c8f36eb4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.071288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:07.104673 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.105289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.105574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.105853 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] PATH_INFO: `/v3/projects/2b55213482de41d888dc3c7e6d859839` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.106990 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b55213482de41d888dc3c7e6d859839)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.108468 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.110300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 225/449] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:06 2022] GET /identity/v3/projects/2b55213482de41d888dc3c7e6d859839 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:07.116523 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:07.178970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547eade-e6d7-4363-92b4-696fcb8da27c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.218994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.220282 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.220472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.220787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.243070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7137-2976-40bd-b75e-815574ba70e7 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.279842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.280473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.280803 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.281141 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] PATH_INFO: `/v3/groups/58ce052280b746478c4d890f54ab2d97` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.282193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] RBAC: Authorizing `identity:get_group(group_id=58ce052280b746478c4d890f54ab2d97)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.283654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.285249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 226/450] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:07 2022] GET /identity/v3/groups/58ce052280b746478c4d890f54ab2d97 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:07.291086 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:07.292565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.294046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.295879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:07.336893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:07.390626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197570-fddd-4ab8-a78b-95d05daac80f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.394021 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 225/451] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:14:07.400247 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:07.428254 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.428842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.429123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.429395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.430112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] RBAC: Adding query filter params (group.id=58ce052280b746478c4d890f54ab2d97, role.id=691ab61f8d304445b4d604bb4e2ff005, scope.project.id=2b55213482de41d888dc3c7e6d859839) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:07.430421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.431815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.437597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 227/452] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:14:07 2022] GET /identity/v3/role_assignments?group.id=58ce052280b746478c4d890f54ab2d97&scope.project.id=2b55213482de41d888dc3c7e6d859839&role.id=691ab61f8d304445b4d604bb4e2ff005 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:07.502748 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d214a-8e78-4e9a-bc3e-26ce4a984568 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.504515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:07.541347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.541987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.542266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.542537 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] PATH_INFO: `/v3/projects/8b376485ea1c4cabaaa338eee652b199` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.543758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] RBAC: Authorizing `identity:get_project(project_id=8b376485ea1c4cabaaa338eee652b199)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.545312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.546908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 226/453] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 18 19:14:07 2022] GET /identity/v3/projects/8b376485ea1c4cabaaa338eee652b199 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:07.552598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:07.663381 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6f95-6dc8-43d2-bd99-7e0d18ce730e None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.672377 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:07.697890 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e959f87-0f18-4ba7-9157-bd0e9e08e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.698515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e959f87-0f18-4ba7-9157-bd0e9e08e556 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.698796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e959f87-0f18-4ba7-9157-bd0e9e08e556 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.699070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e959f87-0f18-4ba7-9157-bd0e9e08e556 None admin] PATH_INFO: `/v3/groups/008d4a53a0b548619b3a457e5106a896` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.700177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e959f87-0f18-4ba7-9157-bd0e9e08e556 None admin] RBAC: Authorizing `identity:get_group(group_id=008d4a53a0b548619b3a457e5106a896)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.701641 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e959f87-0f18-4ba7-9157-bd0e9e08e556 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.703203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 228/454] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 18 19:14:07 2022] GET /identity/v3/groups/008d4a53a0b548619b3a457e5106a896 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:07.709762 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:07.814892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1657-8b6a-4baf-b09d-38fac08b6513 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:07.850453 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:07.851326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:07.851607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:07.851888 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:07.852618 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] RBAC: Adding query filter params (group.id=008d4a53a0b548619b3a457e5106a896, role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=8b376485ea1c4cabaaa338eee652b199) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:07.852968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:07.854419 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa255a-aefc-45d6-a80e-0c75946958a3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:07.860220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 227/455] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 18 19:14:07 2022] GET /identity/v3/role_assignments?group.id=008d4a53a0b548619b3a457e5106a896&scope.project.id=8b376485ea1c4cabaaa338eee652b199&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:10.379369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f74052-c1a1-4ecc-b7f5-e090a8ee42da None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:10.379895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f74052-c1a1-4ecc-b7f5-e090a8ee42da None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:10.379895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f74052-c1a1-4ecc-b7f5-e090a8ee42da None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:10.381989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 229/456] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:10.387064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5b400-9b05-45b4-aec5-de639602c82b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:10.387498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5b400-9b05-45b4-aec5-de639602c82b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:10.387704 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5b400-9b05-45b4-aec5-de639602c82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:10.406023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-b0c5b400-9b05-45b4-aec5-de639602c82b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:10.407235 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-b0c5b400-9b05-45b4-aec5-de639602c82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:10.434945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:10.482688 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 228/457] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:10.617091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda86a3-42fd-486e-a373-d13c9b9efb1a None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:10.617381 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda86a3-42fd-486e-a373-d13c9b9efb1a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:10.617904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda86a3-42fd-486e-a373-d13c9b9efb1a None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:10.619740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 230/458] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:10.625352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfa8a-0b5e-45df-867c-a5987e020258 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:10.625904 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfa8a-0b5e-45df-867c-a5987e020258 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:10.626394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfa8a-0b5e-45df-867c-a5987e020258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:10.645244 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-146cfa8a-0b5e-45df-867c-a5987e020258 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:10.646748 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-146cfa8a-0b5e-45df-867c-a5987e020258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:10.717945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 229/459] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:10.744093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d6b5-9693-47f7-9bf0-a63a67789a54 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:10.744748 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d6b5-9693-47f7-9bf0-a63a67789a54 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:10.745230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d6b5-9693-47f7-9bf0-a63a67789a54 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:10.747031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 231/460] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:10.752410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:10.752974 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:10.753451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:10.772597 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:10.774136 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:10.844027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 230/461] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:10.849829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5d6b5-9693-47f7-9bf0-a63a67789a54 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:10.964056 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5d6b5-9693-47f7-9bf0-a63a67789a54 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.001019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.002027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.002531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.003001 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.014217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.015919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:11.031218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:11.032180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:11.033080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:11.033080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:11.033080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:11.035112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 232/462] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:11.041787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.069032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.086678 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.121768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.176212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32f8f-3da3-4fac-8185-0dd14b73242d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.205857 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9900cb-76cb-4518-8e46-a62c5be61726 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.222376 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.223097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.223384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.223661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.224912 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:11.225218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.226877 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d814850-4d53-493e-9406-2ad1400a8fee None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.239165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 231/463] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:11.241386 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1ff4-b1b0-4be2-8840-a143042ed408 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.241673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1ff4-b1b0-4be2-8840-a143042ed408 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.242315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1ff4-b1b0-4be2-8840-a143042ed408 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.247859 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 232/464] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:11.248801 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1ff4-b1b0-4be2-8840-a143042ed408 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.252443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.253108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.253391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.253664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.264796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.266251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:11.281191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:11.282341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:11.283176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:11.283176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:11.283176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:11.283176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 233/465] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:11.283398 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.342727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.362643 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1ff4-b1b0-4be2-8840-a143042ed408 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.377234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.398733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd913-ee18-41b0-90f5-bb2c9e46f6fc None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.400731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15108045-48f3-4085-808c-13da14f831de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.401377 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108045-48f3-4085-808c-13da14f831de None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.401654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108045-48f3-4085-808c-13da14f831de None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.401928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108045-48f3-4085-808c-13da14f831de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.412437 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15108045-48f3-4085-808c-13da14f831de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.413920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15108045-48f3-4085-808c-13da14f831de None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-15108045-48f3-4085-808c-13da14f831de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:11.429864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:11.431157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:11.432418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:11.432418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:11.432418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:11.432418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 233/466] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:11.433224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.433224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.433503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.433603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.434524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.434524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.434787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.435321 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.437071 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.453312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:11.454640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:11.460501 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 234/467] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:14:11 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:11.461378 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.550993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 234/468] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:11.551791 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.637885 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749c541-2630-4348-a9e3-8f19ff839b38 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.647969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.689378 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.690009 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.690297 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.690640 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.691255 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:11.691697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.693862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.700958 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.713715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 235/469] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:11.715405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6c584-75f6-4b2d-a662-4769b6d457f3 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.720755 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.761417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.762676 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.763079 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.763239 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.763899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:11.764203 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.765651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.779250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 235/470] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:11.786742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.870842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fce4df-6bf7-4435-abd5-16b4b48b4647 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.906821 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1e39-c10e-4897-950a-ee7892736949 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:11.909021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.909982 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.910490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.910951 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.911856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.913485 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:11.934981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:11.939545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 236/471] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:14:11 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:14:11.940291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:11.954048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:11.955088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:11.956286 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:11.956854 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:11.958306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:11.960989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:12.003181 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 236/472] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:14:11 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:12.027115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:12.093690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdbbf-a7e6-4a9b-abcc-2116e0e65661 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:12.140645 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:12.141342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:12.141668 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:12.141947 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:12.156098 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:12.157750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:12.178022 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:12.179063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:12.180177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:12.180177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:12.180177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:12.180177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 237/473] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:12.186181 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:12.333609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3475b5-66c7-4623-82f5-a7660439cf12 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:12.388573 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:12.389620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:12.390123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:12.390598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:12.391505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:12.391946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:12.393557 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb711a-c277-4138-b370-038999963ca9 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:12.407780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 237/474] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:12.413287 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:12.542548 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122f149-fe3c-499e-ae2b-854f34f48512 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:12.546233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:12.591283 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe9dc3-1346-419f-97b4-b3ad24e44125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:12.591972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe9dc3-1346-419f-97b4-b3ad24e44125 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:12.592247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe9dc3-1346-419f-97b4-b3ad24e44125 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:12.592521 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe9dc3-1346-419f-97b4-b3ad24e44125 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:12.593210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe9dc3-1346-419f-97b4-b3ad24e44125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:12.594813 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe9dc3-1346-419f-97b4-b3ad24e44125 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:12.619746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 238/475] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:14:12 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:14:13.922547 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011dc63-83b4-417a-aca5-c8a9098d4ef5 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:13.923297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011dc63-83b4-417a-aca5-c8a9098d4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:13.923297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011dc63-83b4-417a-aca5-c8a9098d4ef5 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:13.924300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 238/476] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:13.929797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:13.930561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:13.930561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:13.949493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:13.950697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:14.062930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 239/477] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:14.391097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011dc63-83b4-417a-aca5-c8a9098d4ef5 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:14.439398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:14.501809 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011dc63-83b4-417a-aca5-c8a9098d4ef5 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:14.540365 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:14.541023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:14.541302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:14.541570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:14.551931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:14.556841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:14.558930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:14.560436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 239/478] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:14.564318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:14.669676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:14.686539 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3297a-65f7-4305-8da3-f97617b3a13e None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:14.737551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:14.738198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:14.738478 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:14.738755 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:14.739462 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:14.739875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:14.742081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdb515-04ca-41be-99d8-f1a0d37b1b71 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:14.754026 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 240/479] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:14.760107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:14.885482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d92453-0dd5-4e63-9e69-65b9940e6091 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:14.887586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:14.919076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f4606-77b3-48ac-b734-1af711f26e43 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:14.919409 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f4606-77b3-48ac-b734-1af711f26e43 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:14.919630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f4606-77b3-48ac-b734-1af711f26e43 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:14.921351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 241/480] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:14.926695 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac52c1-1f09-462c-bdc4-a87205f38d92 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:14.926970 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac52c1-1f09-462c-bdc4-a87205f38d92 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:14.927398 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac52c1-1f09-462c-bdc4-a87205f38d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:14.929113 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:14.930335 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:14.930751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:14.931156 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:14.943714 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:14.945584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:14.948369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-1dac52c1-1f09-462c-bdc4-a87205f38d92 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:14.950094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-1dac52c1-1f09-462c-bdc4-a87205f38d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:14.962329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:14.963487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:14.964554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:14.964554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:14.964554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:14.966432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 240/481] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:14.973127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.033014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 242/482] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:15.034364 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb86bbd-e2f1-4156-88b8-dbc3bba0a1a2 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.034649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb86bbd-e2f1-4156-88b8-dbc3bba0a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.034923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb86bbd-e2f1-4156-88b8-dbc3bba0a1a2 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.036149 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 243/483] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:15.037215 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a9a5-ea06-47fa-a048-81b465753cc6 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.037554 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a9a5-ea06-47fa-a048-81b465753cc6 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.037831 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a9a5-ea06-47fa-a048-81b465753cc6 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.039148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 244/484] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:15.041915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782770-0600-4f3c-b4e8-6d7505ad7af7 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.042209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782770-0600-4f3c-b4e8-6d7505ad7af7 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.042471 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782770-0600-4f3c-b4e8-6d7505ad7af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.060675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-83782770-0600-4f3c-b4e8-6d7505ad7af7 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:15.061895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-83782770-0600-4f3c-b4e8-6d7505ad7af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:15.097009 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8f925-e7ea-4165-ae94-657ea1c405b0 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.134402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 245/485] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:15.135737 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.136019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.136293 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.147478 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.148325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.148833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.149294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.150027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:15.150328 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:15.151708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:15.164332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:15.164644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 241/486] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:15.166174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:15.180795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.180970 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:15.187115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:15.265884 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 246/487] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:15.282284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5c90-bb7d-42e1-8803-be9748101249 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.316999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.317632 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.318474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.318750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.325929 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:15.327362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:15.340558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:15.341481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:15.342780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 242/488] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:15.347710 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.371656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.458488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa142-e217-4494-a5ef-f8c0b1ae30a1 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.461045 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:15.494316 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4be291-0bd7-4a36-bd65-1ab0b7637944 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.506257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.506953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.507240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.507588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.508325 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:15.508633 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:15.510095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:15.529793 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.530416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.530695 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.530967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.542418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:15.543805 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:15.548215 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 247/489] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:15.548442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:15.549396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:15.550201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:15.551796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.554732 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 243/490] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:15.555781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.660333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efa60-fa5c-4af1-9221-cfccb73ca118 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.671058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308c1a-e3a5-40f6-8586-1a168f6d534f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.695884 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.696518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.696841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.697136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.704723 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.705319 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.705595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.705865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.707208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:15.708414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:15.712479 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:15.713572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:15.714701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:15.718439 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 248/491] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:15.719134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.776693 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:15.778256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:15.792937 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:15.844384 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f5d8-103b-4f9e-967d-0142216ec4b0 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:15.883717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:15.884541 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:15.884653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:15.884909 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:15.885577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:15.885907 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:15.887334 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:15.895836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 244/492] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:15.901260 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 249/493] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:15.901469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.901622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:15.938510 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.007512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12eba6-9e87-4f6a-ac90-185bc6022caa None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.013934 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f02e3a-f94d-4f09-ba0b-973bef3d161f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.035987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.042495 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.043137 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.043416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.043689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.049682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.050317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.050612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.050891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.051562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:16.051869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.053899 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.056386 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:16.061202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.062171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:16.062980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 245/494] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.064311 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.065116 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 250/495] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:16.065658 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.165861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.173399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcc3d0-3cd3-491c-b6a8-4e8f30f28721 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.189682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed34a-ad23-433b-bc39-108205a74b94 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.206389 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.207018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.207300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.207578 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.218057 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.219621 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.223520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.224718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.225000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.225276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:16.234881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.235778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:16.241034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:16.241034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.241034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:16.241258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.241341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 246/496] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.241341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.241483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:16.254734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.255738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:16.256572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:16.256572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.256572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:16.256572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 251/497] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.256572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.292367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.346012 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eebfe3-39a5-4eb1-9a01-f2e4696e7c7b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.357902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575158b9-a68e-42ef-b94f-91427ca80bb5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.381395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.382022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.382299 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.382570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.391590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.392189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.392300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.392468 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.392768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.393430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:16.393710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.393798 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.395046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.401081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.403571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 252/498] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:16.404372 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:16.409967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.411084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:16.412655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:16.412655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.412655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:16.412655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 247/499] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.412956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.508692 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.513496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314be1a-fdfd-4056-9611-05e1442bc40c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.515208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416cdfb-4d53-479b-8e65-def5b1622939 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.555502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.556030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.556314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.556587 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.557264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:16.557573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.558942 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.559939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.560540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.560853 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.561132 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.561769 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:16.562120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.563565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.571213 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 253/500] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:16.572122 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.578949 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 248/501] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:16.579773 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.638967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.676845 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e8e7-6cb6-48cb-a4a9-0dc87aab65fa None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.681093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44857-8ac2-4e0a-8ad2-8bb5135374a5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.712605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.713332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.713644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.713933 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.715449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.716049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.716330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.716605 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.717304 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:16.717622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.719512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.724630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.726768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.731356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 249/502] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:16.731997 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:16.740774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.741767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:16.742596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:16.742596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:16.742596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:16.742596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 254/503] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.742820 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.756037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.834653 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c465e6-c838-4e32-a2a8-c5232de31ca8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.847221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96b471-7065-48a5-b20c-2d1fca3dd9e2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:16.853051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.870397 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.871025 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.871310 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.871585 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.879036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.880514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.881688 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:16.882321 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:16.882604 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:16.882885 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:16.890093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:16.891503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.892564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:14:16.893709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:16.894214 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:16.894289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 250/504] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.895229 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:16.906496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:16.907425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 255/505] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:16.913581 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:16.980652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:16.997634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2fd3c-f489-4ae3-bd63-b3c2e0a68200 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.013871 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060331ee-1293-4a54-87e0-9e6cd96239c8 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.033513 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77383c-a39d-4466-a873-32adce547723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.034148 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77383c-a39d-4466-a873-32adce547723 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.034425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77383c-a39d-4466-a873-32adce547723 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.034699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77383c-a39d-4466-a873-32adce547723 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.043813 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77383c-a39d-4466-a873-32adce547723 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.045640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77383c-a39d-4466-a873-32adce547723 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.049636 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.050457 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.050845 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.051189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.052027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:17.052483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.054478 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-de77383c-a39d-4466-a873-32adce547723 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:17.057379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:17.058255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 251/506] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:17.060761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77383c-a39d-4466-a873-32adce547723 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.072938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 256/507] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:17.073802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.108208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.172202 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77383c-a39d-4466-a873-32adce547723 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.176556 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a835e-edb5-46a3-a3da-37052be254fc None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.205080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.205689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.205892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.206010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.206231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.206962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:17.207267 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.209306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.213015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.213614 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.213893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.214165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.214857 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:17.215156 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.216598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.236306 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 257/508] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:17.237283 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.246633 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 252/509] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:17.247485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.338405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e169-84a4-4740-bbc3-952613b9701b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.343361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.349800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406baa-938a-4ba2-a15a-8b2965c6a6d4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.372490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.373049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.373329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.373596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.374326 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:17.374619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.376037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.385661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.386463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.386893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.387242 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.393201 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 258/510] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:17.394046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.394459 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.395980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:17.408807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:17.409833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 253/511] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:17.410721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.446561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.497574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fe289-c073-446c-84af-625332f58f8c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.509849 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943dca5-830a-4067-b154-fbadd64781b6 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.532145 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.532791 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.533078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.533353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.534072 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=1b3a5ebc5fe740ab818293c3c0b3c31b) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:17.534379 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.535842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.541158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 259/512] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/role_assignments?user.id=1b3a5ebc5fe740ab818293c3c0b3c31b&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:17.541989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.557232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.557865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.558245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.558588 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.593622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.643396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.644870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.666331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fdefb-1270-4aa2-9860-6f3d143489e5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.682355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.710388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.711006 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.711285 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.711559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.760267 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 254/513] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:17.765774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.793141 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.794618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.837538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.892592 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ffc2-bd97-4bc3-b7f8-c1ad02e420c7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:17.910657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 260/514] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:17.910657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:17.926097 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:17.934355 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:17.934961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:17.935700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:17.935979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:17.937018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:17.937327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:17.939412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:17.966538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 255/515] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:17.966538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.017955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894638-8dec-4d1e-9753-5a6ceecf15c6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.059115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.059807 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.060048 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.060297 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.071159 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.072621 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:18.088551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:18.089575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:18.095173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:18.095173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:18.095173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:18.095338 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fab17-cba0-48ad-9d77-691572ae2ba5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.095742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 261/516] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:18.095742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.112094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.135471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.136093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.136370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.136838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.147674 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.149189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.161164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:18.167357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:18.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:18.169989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:18.169989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:18.169989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:18.169989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 256/517] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:18.169989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.220488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a520a-a1d3-4f76-9bfe-af79afe82284 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.259030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.259650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.259930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.260210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.281033 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2cb13-c579-4ff9-adf4-34d297f07150 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.323719 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.324339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.324676 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.324978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.325819 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:18.325945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.327273 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.332531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.334558 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.340171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 257/518] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:18.341166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.378260 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.402046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.446069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 262/519] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:18.446508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.470110 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80c435-a6d0-4f17-b4da-2ac6f3e856be None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.510940 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.511706 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.512073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.512466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.513256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:18.513657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.515126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.534957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 258/520] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:18.534957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.560111 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a619a-1963-4eb3-9ef1-281fab2d8623 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.606564 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.607221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.607499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.607769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.614936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.616357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:18.627644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:18.628672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:18.629797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:18.631805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.633807 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 263/521] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:18.634594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.654637 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f311-6cc0-4f70-876a-06d599892a76 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.662692 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.701978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.702895 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.703356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.703776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.717876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.719361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:18.736232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:18.737436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:18.738317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:18.738317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:18.738317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:18.738317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 259/522] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:18.738317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.755144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3a64-a889-4576-bb41-7a095efffc85 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.796599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.797668 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.798466 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.799178 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.808290 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.810317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:18.824477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:18.825546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:18.826619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:18.830670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 264/523] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:18.831107 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.847901 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dbb36-292b-4ea7-965d-73d1cd2b2a1c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.884348 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.885005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.885279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.885549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.886230 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:18.886526 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.887953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.899494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.915001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 260/524] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:18.915001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:18.924847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:18.944361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655bb64-1389-45b8-a613-eb02880d1561 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:18.983655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:18.984199 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:18.984487 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:18.984831 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:18.985486 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:18.985798 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:18.987225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:18.999829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 265/525] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:19.000675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:19.031406 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29804d-2313-4949-9a43-33e714e0d98f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:19.070600 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:19.071446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.071870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.072282 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.073146 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:19.073617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:19.075191 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:19.092737 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 261/526] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:19.092737 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:19.118609 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144387bd-bc11-405f-af93-6c40a89cd0d2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:19.155297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:19.156545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:19.157595 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.157977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.158261 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.159119 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=01123f6512bb4554bf757a1ca0cc46da) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:19.159414 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:19.160936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:19.167788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 266/527] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:18 2022] GET /identity/v3/role_assignments?user.id=01123f6512bb4554bf757a1ca0cc46da&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:19.178975 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:19.200256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:19.213577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a19d9a-eeb1-43da-a087-9b24517693d2 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:19.267619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:19.269327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.270002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.270592 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.281313 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:19.283981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:19.304149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:19.305157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:19.305991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:19.307312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 262/528] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:19.312482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:19.315202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb671133-8de6-4a15-bfe8-ba180659bcf0 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:19.360484 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:19.362713 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.362713 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.362713 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.363258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=c92ff75ad2d142e1951491932002b036) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:19.363567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:19.365152 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:19.371955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 267/529] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:19 2022] GET /identity/v3/role_assignments?user.id=c92ff75ad2d142e1951491932002b036&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:19.441099 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178a30-2391-4f70-842a-b986e64a97a7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:19.463996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:19.486451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:19.487092 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.487373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.487648 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.488359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:19.488657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:19.490211 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512f96c-152d-4b1d-b92d-01dfa686a9b0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:19.505833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 263/530] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:19.511512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:19.605448 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:19.641222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc149-bf84-4407-90eb-c762a7153e49 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:19.677862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:19.678614 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.678904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.679182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.679909 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=d18820ebfa644e8585f64355e8bf0f71) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:19.680219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:19.681765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb236b-469e-49c6-a221-492709d748e1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:19.688199 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 268/531] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:19 2022] GET /identity/v3/role_assignments?user.id=d18820ebfa644e8585f64355e8bf0f71&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:19.761285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3d6e-5b52-4857-a4d2-407e4b4167c2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.761614 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3d6e-5b52-4857-a4d2-407e4b4167c2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.761844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3d6e-5b52-4857-a4d2-407e4b4167c2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.763511 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 264/532] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:19.769300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:19.769660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:19.769871 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:19.790284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:19.791551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:19.876829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 269/533] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:20.207958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3d6e-5b52-4857-a4d2-407e4b4167c2 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:20.315233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3d6e-5b52-4857-a4d2-407e4b4167c2 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:20.349796 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:20.351203 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:20.351541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:20.351874 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:20.364442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:20.369893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:20.371007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:20.372011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:20.372989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 265/534] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:20.378403 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:20.446170 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:20.484114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7191b8-2fdb-4e7e-96a9-5e8376fe14cb None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:20.525391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:20.526153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:20.526506 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:20.526845 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:20.527637 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:20.528005 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:20.529577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:20.540125 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 270/535] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:20.545962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:20.621065 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:20.668604 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe109a-58e7-42a9-9d82-cc53f2c94a8d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:20.704371 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:20.705169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:20.705517 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:20.705904 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:20.717268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:20.718817 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:20.735094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:20.736248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:20.737373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:20.737373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:20.737373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:20.738581 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 266/536] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:20.749846 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:20.869519 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4d30-8fc8-46d3-93e2-1214f7380ab4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:20.901057 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:20.906344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:20.906972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:20.907250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:20.907524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:20.908196 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:20.908498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:20.910078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:20.924816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 271/537] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:20.930196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:21.027657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:21.038058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c97d2-05e8-4f12-ae23-679bb971a7b4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:21.077300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:21.077941 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.078225 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.078502 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.087919 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:21.089407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:21.101434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:21.102378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:21.103626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 267/538] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 18 19:14:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:21.108577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:21.215663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185ec2-2071-4232-8e1b-846552c95489 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:21.254109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:21.254731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.255011 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.255818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.256557 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:21.256957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:21.258451 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:21.279582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 272/539] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 18 19:14:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:21.285311 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:21.398261 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4315ae-8ab7-4c11-a305-6c888932f327 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:21.434619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:21.435275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.435558 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.435837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.447732 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:21.449268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-7d90a776-6d2d-40a2-964c-6d5869137a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:21.465150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:21.466190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:21.467412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:21.467412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:21.467412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:21.467412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 268/540] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:21.472270 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:21.529425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:21.549219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897c80-c7ee-44f0-9014-4d2f130c3173 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.549504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897c80-c7ee-44f0-9014-4d2f130c3173 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.549684 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897c80-c7ee-44f0-9014-4d2f130c3173 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.555541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 269/541] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:21.556954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.557245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.557525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.564971 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:21.580566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:21.582161 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:21.606582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7243b15-b1b3-4689-8cbc-3c50adbfe6eb None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:21.651374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:21.652357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.653021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.653310 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.653977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:21.654286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:21.655649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:21.678074 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 270/542] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:21.678271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 273/543] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:21.679716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:21.788565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb1a3-425a-43ee-892e-f042a61b2823 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:21.821347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:21.826691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:21.827329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.827612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.827885 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.836119 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:21.837612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-5d2ff922-c596-4c02-b4da-f473dc172090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:21.849412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:21.850364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:21.851701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 271/544] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:21.857815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:21.883884 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeaae3-e2a7-45f4-b409-eaf9d9f2d0b2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.884333 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeaae3-e2a7-45f4-b409-eaf9d9f2d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.884739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeaae3-e2a7-45f4-b409-eaf9d9f2d0b2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.886552 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 272/545] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:21.892443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:21.892933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:21.893658 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:21.917591 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:21.919545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:22.019318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001e563-2fda-42e7-90f3-2e9e715f6cd6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.028990 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.031067 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 273/546] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:22.035896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.077355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.078023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.078313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.078600 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.079309 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:22.079619 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:22.081199 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965957-9d51-4c3c-8805-4b6c38b515f6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:22.104457 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 274/547] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:22.105502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f318-3619-412c-b7c8-b613ef4448b5 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.105801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f318-3619-412c-b7c8-b613ef4448b5 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.106075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f318-3619-412c-b7c8-b613ef4448b5 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.107685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 275/548] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:22.112888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f318-3619-412c-b7c8-b613ef4448b5 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.160093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca08e05-0488-40f7-822f-1a530a53da6d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.186043 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.199505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277af10-afd9-4784-89d2-078a17c4ac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.200147 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277af10-afd9-4784-89d2-078a17c4ac33 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.200426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277af10-afd9-4784-89d2-078a17c4ac33 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.200731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277af10-afd9-4784-89d2-078a17c4ac33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.211944 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277af10-afd9-4784-89d2-078a17c4ac33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3277af10-afd9-4784-89d2-078a17c4ac33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:22.216728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:22.217820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:22.218615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 274/549] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:22.219480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.219770 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.220044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.235463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f318-3619-412c-b7c8-b613ef4448b5 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.239233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:22.241358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:22.274951 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.275595 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.275880 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.276162 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/1b3a5ebc5fe740ab818293c3c0b3c31b/roles/3664513bdfb64f3bb56a3c2c5769b1d1` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.292828 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=1b3a5ebc5fe740ab818293c3c0b3c31b, role_id=3664513bdfb64f3bb56a3c2c5769b1d1)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:22.294341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:22.320711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 276/550] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:14:22 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/1b3a5ebc5fe740ab818293c3c0b3c31b/roles/3664513bdfb64f3bb56a3c2c5769b1d1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:22.320711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.330018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 275/551] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:22.351131 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.371229 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.472509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0432876-c96d-4707-b802-7c11cdf83bc5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.516933 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.517888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.518390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.518666 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.518986 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982c34-321f-412c-9bc3-fd326cc293cb None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.519336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:22.519639 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:22.521059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:22.531354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 277/552] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:22.535747 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.536275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.574580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.575231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.575494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.575768 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.598463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:22.604302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:22.605356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:22.606926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 276/553] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:22.613868 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.649966 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.675676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676d852-d7f2-4155-a817-880cbd4fc926 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.715454 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.716765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.717572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.718311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.726206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da641cb4-c49a-4f23-9448-df43acdbf3fa None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.734132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:22.736221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:22.756863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:22.757915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:22.758798 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:22.758798 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:22.758798 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:22.759497 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 278/554] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:22.759839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.764496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.765137 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.765421 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.765960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.767458 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] RBAC: Adding query filter params (name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:22.767781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:22.769274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:22.780253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 277/555] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:22.781127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.822907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.893132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6869-b5ba-4ea7-b773-37e7bd6b9e45 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.901664 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698064-b940-4f0c-be3b-b81ad918b966 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:22.924488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:22.931784 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.932524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.932853 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.933122 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.940212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:22.941045 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:22.941331 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:22.941599 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:22.942238 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:22.942702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:22.944075 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:22.944989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:22.950349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:22.951275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:22.952114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:22.955042 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 279/556] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:22.955042 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:22.963017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 278/557] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:22.963902 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.071094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.077968 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e86d-3325-4d8a-9f5e-a01504eeb76e None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.090216 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5742d-7093-425b-be6e-d66cadf8b13d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.117645 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.118542 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.119000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.119428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.128648 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.129282 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.129564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.129837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.131072 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] RBAC: Adding query filter params (name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:23.131372 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.132725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.132857 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.134461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.142476 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 279/558] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:23.143378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:23.154419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:23.155416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:23.156360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:23.156360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:23.156360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:23.162761 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 280/559] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:23.162761 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.208742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.278096 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073c3f-5366-4885-95dd-02b700fc5d78 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.281050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f868f5-5e42-4d5c-a8b2-1d2cec011b4a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.322177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.323416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.323942 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.324407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.330949 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.331806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.332059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.332412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] PATH_INFO: `/v3/users/glance` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.338367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.339805 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.341426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.342860 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:23.356222 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:23.357291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:23.358256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:23.358256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:23.358256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:23.358432 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:23.364351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 280/560] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:23.365989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.366660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 281/561] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:23.366660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.386575 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.499658 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a6dce-1a38-493a-8631-f2c65c1ef2bb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.506266 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.515603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef57c23-6fb3-4b44-a2a8-4ac2e839a3d4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.542168 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.542776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.543058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.543334 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.543981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:23.544290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.545691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.556308 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.556949 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.557240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.557584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.562958 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:23.563118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 281/562] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:23.563220 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.563301 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.563388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.588882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 282/563] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:23.588882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.679209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.704002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fad7f4-2d17-412b-8908-4dd967d1b45f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.706799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1bb94-418c-4a5b-aa29-1cf2d4089eff None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.747200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.747804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.748079 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.748437 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.756339 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.757748 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.762189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.762808 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.763099 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.763361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.764013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:23.764415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.765829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:23.771868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:23.772892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 283/564] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:23.778422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.785934 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 282/565] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:23.791490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.796398 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.901524 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f553-7cfc-44b4-bb35-fae240b1409c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.909715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc534fa2-30e9-4fba-9a99-e2ea563a81dc None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:23.943683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.944300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.944577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.944907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.945756 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:23.946187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.947634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.951062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:23.951217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:23.951986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:23.952364 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:23.952707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:23.964939 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:23.966403 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:23.970367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 283/566] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:23.971375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:23.983502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:23.984712 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:23.985612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:23.985612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:23.985612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:23.989350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 284/567] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:23.990281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.061530 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.085074 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed7c0-cf8a-44d5-b345-b5470a17611d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.105482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a99f-379d-45ce-8402-0f8466186e4d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.123591 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.124240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.124523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.124845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.132984 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.134450 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.143659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.144537 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.145021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.145444 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:24.147312 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:24.148420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:24.149402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 284/568] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:24.150011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.165871 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.167742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:24.187913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:24.189747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:24.190870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:24.190870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:24.190870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:24.190870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 285/569] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:24.190870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.230646 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.288669 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8703-fa1a-4752-82be-c8b4dab9505d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.307373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999213d7-c328-4c8b-9d49-da558463a403 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.326007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.329648 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.330389 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.330672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.330948 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.331606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:24.332189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.333356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.346796 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 285/570] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:24.347796 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.353032 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.353670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.353955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.354233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.354983 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:24.355292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.356908 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.377189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 286/571] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:24.378045 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.465368 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe38c28-e6c7-432e-b2a7-9e2aae03018b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.480493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.503744 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363a99-7047-4e07-9747-6d6661d89fcb None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.507257 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.507881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.508167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.508446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.509147 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:24.509449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.510838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.524661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 286/572] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:24.525609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.556531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.557252 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.557579 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.557859 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.565016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.566449 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:24.578733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:24.579795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 287/573] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:24.581463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.623926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.648042 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f422c6-3efc-4a6a-a7db-1b02fe1b5d14 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.683783 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.684418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.684699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.684992 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.697297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.697608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357bf4f-4836-481e-8108-e6c40aeb8c67 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.698753 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:24.713069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:24.714220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:24.715115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:24.715115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:24.715115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:24.715115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 287/574] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:24.715341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.734140 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.734877 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.735228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.735572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.742976 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.744430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.744996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-4681c8f4-d7ee-47af-a8ee-93e2aa223b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:24.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:24.758031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:24.759112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 288/575] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:24.759622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198342-01e2-4f31-ad2d-8472dae7a55c None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.759622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198342-01e2-4f31-ad2d-8472dae7a55c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.760148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198342-01e2-4f31-ad2d-8472dae7a55c None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.765264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 289/576] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:24.765264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198342-01e2-4f31-ad2d-8472dae7a55c None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.831356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a8db-8b1d-4265-95ea-26a35415afce None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.864154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.865613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.866207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.866485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.866756 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.867451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:24.867753 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.869228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.876926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198342-01e2-4f31-ad2d-8472dae7a55c None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:24.881843 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 288/577] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:24.882661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:24.914359 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:24.914970 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.915250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.915522 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.916161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:24.916459 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:24.917867 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f0ab5-682c-4b48-b744-8d4126094af9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:24.934836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 290/578] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:24.936095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:24.936378 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:24.936829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:24.955852 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:24.957103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:24.977330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:24.993772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5d25-36cc-4aba-9c6c-02a0a418a476 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.029978 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 291/579] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:25.030897 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.039096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.040280 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.040570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.040876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.041619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:25.042420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.044111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.066946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 289/580] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:25.066946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.154071 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:25.178113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5fab-55b7-4216-b610-85ae02257417 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.205076 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016a4f-711d-4581-b831-3efc1de94d38 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.222392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.223053 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.223336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.223612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/01123f6512bb4554bf757a1ca0cc46da/roles/3664513bdfb64f3bb56a3c2c5769b1d1` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.242258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=01123f6512bb4554bf757a1ca0cc46da, role_id=3664513bdfb64f3bb56a3c2c5769b1d1)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.243440 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.244265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.244720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.245141 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.245253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.252914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.254274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.267188 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 292/581] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:14:25 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/01123f6512bb4554bf757a1ca0cc46da/roles/3664513bdfb64f3bb56a3c2c5769b1d1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:25.267482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:25.269272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:25.271268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:25.273612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 290/582] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:25.274335 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.274554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.286039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:25.421617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5d66-7582-420d-b972-7b6013eacb21 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.423291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22c21e-c1c4-4d10-a086-a99a44133b35 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.472598 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.473492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.474448 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.475303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.475507 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:25.476081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.480140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.487055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.487882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.488296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.488726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/c92ff75ad2d142e1951491932002b036/roles/3664513bdfb64f3bb56a3c2c5769b1d1` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.492999 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:25.498629 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 291/583] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:25.500069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.514274 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=c92ff75ad2d142e1951491932002b036, role_id=3664513bdfb64f3bb56a3c2c5769b1d1)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.516987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.533489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 293/584] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:14:25 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/c92ff75ad2d142e1951491932002b036/roles/3664513bdfb64f3bb56a3c2c5769b1d1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:25.534673 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.635852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:25.680669 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348176-9368-4948-ae14-5d4fd73ea610 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.693467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca705b4-a230-4ac8-92f0-f0d037fe59df None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.735563 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.736468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.737237 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.737503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.745359 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.746173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.746564 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.746940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/d18820ebfa644e8585f64355e8bf0f71/roles/3664513bdfb64f3bb56a3c2c5769b1d1` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.751379 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:25.756715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:25.757852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:25.758893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 292/585] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:25.767097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:25.773387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=d18820ebfa644e8585f64355e8bf0f71, role_id=3664513bdfb64f3bb56a3c2c5769b1d1)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.775557 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.794413 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 294/586] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:14:25 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/d18820ebfa644e8585f64355e8bf0f71/roles/3664513bdfb64f3bb56a3c2c5769b1d1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:14:25.908289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2542ac-a2a1-4cd3-9ee8-d6e8293c95d4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:25.941384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:25.953642 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:25.954640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:25.955103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:25.955556 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:25.956562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] RBAC: Adding query filter params (name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:25.957113 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:25.958797 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:25.969421 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 293/587] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:25.976186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:26.018884 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:26.098976 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a197-ac98-4a9f-af10-e08a15959ffc None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:26.135546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:26.136452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:26.136840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:26.137183 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:26.149772 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:26.151231 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:26.168264 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:26.169331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:26.170751 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:26.170751 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:26.170751 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:26.170751 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 295/588] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:26.177207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:26.286761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4e4c2-0c52-48cd-8860-53f4dbe0bc23 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:26.326614 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:26.327257 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:26.327596 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:26.327924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:26.328584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:26.328922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:26.330473 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:26.343988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 294/589] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:26.349658 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:26.445801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:26.466653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd03cb-843b-477f-9e4c-9a82bd7df13c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:26.503820 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:26.504629 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:26.505506 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:26.505844 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:26.514056 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:26.515509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:26.528154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:26.529223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:26.530168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 296/590] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 18 19:14:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:26.537546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:26.601249 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:26.659398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad703f-becd-4b12-a754-8676b3291e8a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:26.698672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:26.699725 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:26.700256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:26.700751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:26.701710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:26.702232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:26.703916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:26.723162 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 295/591] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 18 19:14:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:26.729610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:26.858350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488150f6-95c1-42b2-8695-ca8e18759a0d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:26.897384 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:26.898491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:26.899000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:26.899563 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:26.934304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:26.984045 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:26.985682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:27.126370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 297/592] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:27.132182 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:27.245420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257a19-2a93-4381-a5c3-3abab8f47c77 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:27.253886 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:27.284941 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:27.285959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.286978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.287453 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.299107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:27.300972 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:27.317686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:27.318716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:27.319611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:27.319611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:27.319611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:27.321755 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 296/593] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:27.327471 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:27.380062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:27.441185 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323e526-847d-4d76-b6a5-9a5dadeb83ee None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:27.478640 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:27.479378 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.479567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.479793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.480445 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:27.480770 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:27.482163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:27.495403 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 298/594] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:27.501048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:27.627815 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024e3d-01ea-4eeb-9b3b-520b240bf80e None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:27.669826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:27.670833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.671319 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.671792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.692266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:27.694643 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3eadcf12-887d-4adf-b1d8-6dcd743b4c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:27.707466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:27.709014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:27.709910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:27.710785 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 297/595] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:27.716829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:27.797284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e6f28-9b8e-46e7-b7c8-1efaa0078d39 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.797642 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e6f28-9b8e-46e7-b7c8-1efaa0078d39 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.797876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e6f28-9b8e-46e7-b7c8-1efaa0078d39 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.799643 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 298/596] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:27.805668 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e852-cb2c-4afd-aa4a-4e67d8fc8e35 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.806045 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e852-cb2c-4afd-aa4a-4e67d8fc8e35 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.806232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e852-cb2c-4afd-aa4a-4e67d8fc8e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.827164 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-f935e852-cb2c-4afd-aa4a-4e67d8fc8e35 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:27.828402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f935e852-cb2c-4afd-aa4a-4e67d8fc8e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:27.844759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be2e7f-e612-4310-a177-d4a94e61c38b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:27.853396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:27.857683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:27.889795 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:27.890423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.890709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.890986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.891690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:27.892002 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:27.894047 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:27.910579 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 299/597] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:27.915775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:27.928924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 299/598] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:27.975331 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5aa2c-b657-4646-bf3c-cac93131808b None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.975709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5aa2c-b657-4646-bf3c-cac93131808b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.976165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5aa2c-b657-4646-bf3c-cac93131808b None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:27.978001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 300/599] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:27.983772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe274e4-e434-4b50-804e-f42cdb45ee24 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:27.984111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe274e4-e434-4b50-804e-f42cdb45ee24 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:27.984338 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe274e4-e434-4b50-804e-f42cdb45ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.003866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-1fe274e4-e434-4b50-804e-f42cdb45ee24 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:28.005864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1fe274e4-e434-4b50-804e-f42cdb45ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:28.033900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475ae8d-d255-4321-9eed-ce2aaaf177f4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.070344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:28.070964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.071245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.071522 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.072254 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=1b3a5ebc5fe740ab818293c3c0b3c31b) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:28.072558 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:28.074502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc82868-ca0e-4189-8480-4d2af34d6197 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:28.085391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 300/600] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:27 2022] GET /identity/v3/role_assignments?user.id=1b3a5ebc5fe740ab818293c3c0b3c31b&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:28.094303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 301/601] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:28.146335 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0c36-f6c7-44ce-b6b4-01758ad1eeda None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.146626 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0c36-f6c7-44ce-b6b4-01758ad1eeda None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.146921 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0c36-f6c7-44ce-b6b4-01758ad1eeda None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.148535 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 301/602] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:28.154557 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.155134 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.155566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.175899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:28.178121 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:28.262223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 302/603] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:28.307604 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0c36-f6c7-44ce-b6b4-01758ad1eeda None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.341437 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:28.424719 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0c36-f6c7-44ce-b6b4-01758ad1eeda None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.437421 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.449431 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:28.479594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:28.480972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.481809 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.482324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.498323 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:28.504533 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:28.505812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:28.506746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:28.507373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 302/604] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:28.513207 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.566346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9daa32-542f-42f8-854c-59bd986b4442 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.604937 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:28.605727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.606166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.606474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.616740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:28.618930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:28.624046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:28.626390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:28.630387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 303/605] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:28.632049 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.634027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea188-d81e-46f2-940d-32f1268a7088 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.680882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:28.681686 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.682015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.682395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.683250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:28.683727 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:28.685276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:28.697189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 303/606] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:28.697880 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.727309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:28.770958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7bf3-ef98-4f8d-ab75-8c70223c1735 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.815942 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:28.816775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.817157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.817463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.827590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a91c-b2ef-4a23-8612-b8f46f0778a9 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.829366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:28.834708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:28.835908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:28.836962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 304/607] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:28.837827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.872772 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:28.873424 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:28.873706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:28.873978 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:28.874648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:28.874952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:28.876315 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:28.885678 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 304/608] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:28.889778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:28.908110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:28.963506 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c8e64-70ff-4f0c-9c0c-58bbd07fbc84 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:28.993565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.003576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.004118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.004400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.004589 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f9cce-57cd-4496-983c-b993657c85f1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.004823 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.015454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.016954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:29.034172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:29.035212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:29.036108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:29.036108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:29.036108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:29.036108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 305/609] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:29.036108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.052217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.053113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.053396 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.053957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.054341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:29.054747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.056039 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.064739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 305/610] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:29.065412 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.176223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3716-85e4-4492-9555-b8a1a4a39855 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.193718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.225381 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.226241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.226515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.226782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf431d-b1d1-4938-abc6-3f1ebc4f0cea None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.226910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.240158 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.241670 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:29.258031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:29.259124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:29.260056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:29.260056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:29.260056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:29.260056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 306/611] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:29.260056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.290515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.291076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.291393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.291620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.292294 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:29.292599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.294121 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.302518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.314924 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 306/612] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:29.314924 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.405988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb63280-bfa0-42c9-9062-11a9876dc36c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.449493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.450139 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.450416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.450691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.453730 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec7e6-d309-4f9c-9128-f937c18acc40 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.463773 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.465672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:29.487469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:29.488504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:29.490037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:29.490037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:29.490037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:29.490037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 307/613] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:29.490037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.517665 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.518390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.518746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.519032 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.519690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:29.520001 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.522062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.524721 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.539277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 307/614] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:29.539277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.626346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.649530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefdba-1331-4f85-84e8-54982818bfeb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.661265 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7cb45-31c0-44ea-a9d3-a21cba079653 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.687880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.688538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.688865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.689222 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.699398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.700935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.703155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.703997 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.704436 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.704910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.705752 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:29.706386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.707819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:29.714345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:29.715683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:14:29.716966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:29.717964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 308/615] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:29.718913 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.729333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 308/616] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:29.733599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.809157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.861620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b31759-f0e5-4fb0-ae0f-08929f0578c7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.870302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab5927-74db-4dda-8300-dd53f0866ec1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:29.899845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.900481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.900838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.901114 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.909951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.911428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:29.923673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:29.930487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 309/617] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:29.931634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:29.932416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:29.933059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:29.933350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:29.933630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:29.934387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:29.935684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:29.936236 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:29.938981 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:29.969775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 309/618] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:29.969775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.062609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6157a1-440d-4ec5-91b3-9bf459e649c6 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.084037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022bca-efb8-46cd-8d91-482483b947ed None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.103062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.103939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.104804 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.105091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.105475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.115329 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.116763 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:30.128814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:30.129852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 310/619] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:30.130781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.136917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.137550 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.137836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.138248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.138855 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:30.139165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.140607 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.163180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 310/620] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 18 19:14:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:30.164371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.212878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.263120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6628d0-dded-42dc-b095-8a506bd9a622 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.284885 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef1414-2788-4a9d-b991-8775e6146cda None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.301062 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.301880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.302669 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.302949 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.325219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.326114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.326404 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.326661 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.328572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:30.328572 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.329648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.356276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 311/621] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:30.357335 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.394609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.397442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.406074 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.467265 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.491070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a468-b67a-4c6c-ba0f-1165ef12a4af None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.511644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 311/622] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:30.512620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.534148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.534829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.535113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.535385 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.612889 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.614430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.635191 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14738606-2a5a-4e4c-85e5-382f44470813 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.643371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.670064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54997edf-0b98-4a0c-8abd-da012d4b2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.670636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54997edf-0b98-4a0c-8abd-da012d4b2171 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.670918 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54997edf-0b98-4a0c-8abd-da012d4b2171 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.671192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54997edf-0b98-4a0c-8abd-da012d4b2171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.701454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.717194 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 312/623] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:30.718043 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.739212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54997edf-0b98-4a0c-8abd-da012d4b2171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.740821 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54997edf-0b98-4a0c-8abd-da012d4b2171 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.821734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43467-b280-42fc-9de7-fa06846ac7f7 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.842481 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 312/624] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:30.843743 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b269-fe79-46c2-9063-5a61253a76e7 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.844096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b269-fe79-46c2-9063-5a61253a76e7 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.844374 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b269-fe79-46c2-9063-5a61253a76e7 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.845620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 313/625] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:30.848726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b269-fe79-46c2-9063-5a61253a76e7 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.856215 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.862822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.863458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.863749 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.864027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.874142 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.875580 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:30.890701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:30.891810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:30.892740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:30.892740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:30.892740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:30.892740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 313/626] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:30.892740 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:30.914039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:30.952671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b269-fe79-46c2-9063-5a61253a76e7 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.985910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:30.986540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:30.986820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:30.987097 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:30.992895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d39a-4316-4165-98fe-96173ad3d9e5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:30.997086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:30.998540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-2b3989cf-3e4d-47ee-9a77-985acfd93912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:31.013832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:31.014858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:31.015752 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:31.015752 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:31.015752 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:31.015752 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 314/627] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:31.016099 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.016366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.016609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.028887 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.029582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.029864 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.030161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.034460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:31.035642 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:31.040986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.042425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:31.057091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:31.058230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:31.059110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:31.059110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:31.059110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:31.059110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 314/628] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:31.059110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.096168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.107928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 315/629] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:31.108954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.166864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.172725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134217-a15d-4d5b-916b-5c11b3a13416 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.208562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.209217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.209505 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.209778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.210429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:31.210729 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.212100 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.228531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 315/630] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:31.228773 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a761b7-f09b-468e-8c54-99d14c88e7ef None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.228895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.265424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.266041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.266330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.266626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.267278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:31.267584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.269043 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.280874 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 316/631] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:31.281698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.332570 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.339452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c659-dbbf-4b53-aff8-e88c9dc9d9f9 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.373672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.374280 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.374562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.374835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.375472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:31.375771 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.377155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.390810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 316/632] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:31.391759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.407347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec016-58d9-47dd-bc1a-1ed311b0ef2e None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.414492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.443810 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.444542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.444863 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.445140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.451960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.453451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:31.464746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:31.466070 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 317/633] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:31.466955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.503030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a93c9-e189-421c-a823-0a4ecc527934 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.537105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.537746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.538018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.538284 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.545142 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.546577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:31.559654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:31.560647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 317/634] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:31.561854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.574233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f52f98-4faa-4aee-afa6-a74f88ae85e5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.580238 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.608963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.609591 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.609870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.610145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.617950 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.619391 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:31.630399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:31.631336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 318/635] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:31.632250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.660058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.675856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f35b4-dff5-4178-bffd-5079b83cae43 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.708768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.709390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.709667 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.709937 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.719742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:31.725358 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:31.726631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 318/636] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:31.727618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.734091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc15792-6fed-493a-b7d5-16e0dc798f0b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.767586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.768187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.768464 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.768765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.769451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:31.769747 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.771215 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.784011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 319/637] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:31.784873 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.814783 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.839338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a738a9-c608-4058-b263-5ce522712ccc None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.872051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:31.873273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.873897 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.874147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.874421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.875115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:31.875415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.876859 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.886784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e467a-8277-4c5f-924b-ce7b97ae38d7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:31.893677 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 319/638] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:31.893677 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.921596 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:31.922287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:31.922570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:31.922836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:31.923514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:31.923815 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:31.925288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:31.936575 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 320/639] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:31.937398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:31.991514 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136ad55-3336-46b1-899d-28bab4dd17fb None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.024666 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.025320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.025569 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.025843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.026504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:32.026804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.028153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.029520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:32.037434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8a87-5739-456b-b11c-828388dfb1d8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.037837 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 320/640] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:32.038631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:32.073766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.074369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.074657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.074933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.075679 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=01123f6512bb4554bf757a1ca0cc46da) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:32.075986 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.077439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.083551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 321/641] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:31 2022] GET /identity/v3/role_assignments?user.id=01123f6512bb4554bf757a1ca0cc46da&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:32.084322 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:32.114861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:32.143794 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02077ae0-85c3-40c9-9c6b-cd93ca72f112 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.184180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.184869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.185155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.185430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.186168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=c92ff75ad2d142e1951491932002b036) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:32.186476 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.187901 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.204718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 321/642] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:32 2022] GET /identity/v3/role_assignments?user.id=c92ff75ad2d142e1951491932002b036&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:32.204718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:32.232250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e36b-90db-4efd-85ef-2135485fb9c9 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.278318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.278851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.279128 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.279404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.280133 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=d18820ebfa644e8585f64355e8bf0f71) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:32.280439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.282037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.291120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 322/643] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:32 2022] GET /identity/v3/role_assignments?user.id=d18820ebfa644e8585f64355e8bf0f71&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:32.316127 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:32.382325 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71438-3c88-496e-8d78-3fb98b929d53 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.422843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.423687 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.424064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.424412 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.437090 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.438786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:32.456603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:32.457685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:32.458652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:32.458652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:32.458652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:32.458652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 322/644] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:32.466281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:32.556402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:32.584673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab25a-fc0b-44ab-95d7-877708b42424 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.629026 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.629696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.630549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.630828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.631488 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:32.631795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.633227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.646412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 323/645] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:32.651616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:32.761299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba68276-0e00-4864-860f-1b7d79f08654 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.775450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:32.798973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.799625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.799907 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.800178 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.813421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.814818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:32.826894 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:32.827952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:32.829631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 323/646] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 18 19:14:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:32.833693 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:32.945050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea71d-cbb3-48dc-8328-d89b55cd07d0 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:32.981366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:32.982191 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:32.982613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:32.983039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:32.983798 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:32.984103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:32.985568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:32.987587 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:33.006943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 324/647] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 18 19:14:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:33.013772 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:33.120174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a64602-d15b-4996-9c04-c4a3b01b01d6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:33.154545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:33.155159 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:33.155436 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:33.155704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:33.198981 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:33.226744 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:33.228310 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:33.338614 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 324/648] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:14:33.344301 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:33.457801 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70f616-e011-4fcf-b63e-9f7e711bcf5f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:33.494820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:33.495463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:33.495750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:33.496027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:33.506642 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:33.508175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:33.523794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:33.524826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:33.526958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:33.526958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:33.526958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:33.526958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 325/649] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:33.530739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:33.618410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:33.650225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37a9a-d7a5-462f-8708-867a359545b1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:33.685498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:33.686423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:33.686935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:33.687485 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:33.688329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:33.688868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:33.690432 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:33.703323 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 325/650] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:33.709253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:33.754492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:33.811384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d796-9665-481b-b9fc-cce8246f67e3 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:33.846764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:33.847393 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:33.847676 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:33.847952 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:33.855103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:33.856550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:33.867841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:33.868765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:33.870068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 326/651] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:33.874793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:33.985902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc4ee-51c1-49ca-8339-527fbb4fa43f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:34.017118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:34.023321 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:34.023947 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.024235 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.024515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.025251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:34.025559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:34.027373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499749f1-dbc3-454b-87e8-d25e6e5ba043 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:34.040587 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 326/652] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:34.047422 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:34.158395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b8b8-7367-4193-8b75-7c2eaf62ec1b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:34.161531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:34.198086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:34.198711 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.198994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.199272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.200004 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=1b3a5ebc5fe740ab818293c3c0b3c31b) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:34.200313 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:34.201781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489336b7-8f1c-49ab-a5b6-4532a05beb47 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:34.207994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 327/653] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:34 2022] GET /identity/v3/role_assignments?user.id=1b3a5ebc5fe740ab818293c3c0b3c31b&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:34.586162 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac63e-f3f1-43e8-98c0-7b1240b79289 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.586680 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac63e-f3f1-43e8-98c0-7b1240b79289 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.586680 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac63e-f3f1-43e8-98c0-7b1240b79289 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.588316 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 327/654] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:34.593887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dae38-e7a7-49db-bc11-e5f20f81c628 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.593887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dae38-e7a7-49db-bc11-e5f20f81c628 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.594162 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dae38-e7a7-49db-bc11-e5f20f81c628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.609966 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3fba1-129c-4344-9c20-1550527cb2ea None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.610280 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3fba1-129c-4344-9c20-1550527cb2ea None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.610525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3fba1-129c-4344-9c20-1550527cb2ea None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.612102 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 328/655] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:34.616813 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-aa7dae38-e7a7-49db-bc11-e5f20f81c628 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:34.617903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36619c60-16a3-49d6-ad97-ecebd23b907d None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.618197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36619c60-16a3-49d6-ad97-ecebd23b907d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.618492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36619c60-16a3-49d6-ad97-ecebd23b907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.619153 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-aa7dae38-e7a7-49db-bc11-e5f20f81c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:34.637052 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-36619c60-16a3-49d6-ad97-ecebd23b907d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:34.638256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-36619c60-16a3-49d6-ad97-ecebd23b907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:34.702545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 328/656] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:34.716647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 329/657] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:34.717504 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eff6f-8bda-4d20-9b86-fe1b5ee6409f None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.717801 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eff6f-8bda-4d20-9b86-fe1b5ee6409f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.718082 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eff6f-8bda-4d20-9b86-fe1b5ee6409f None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.719622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 329/658] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:34.725291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:34.725586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:34.725870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:34.748146 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:34.749417 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:34.826158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 330/659] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:35.046268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eff6f-8bda-4d20-9b86-fe1b5ee6409f None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.078216 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.151906 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:35.158324 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:35.167032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eff6f-8bda-4d20-9b86-fe1b5ee6409f None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.204274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.204950 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.205311 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.205508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.206092 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.207456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.210607 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f9d5d-1a26-4e38-b7e4-ce1cc3f2cf4e None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:35.219571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:35.220615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:35.221540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 330/660] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:35.222376 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.251433 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.252177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.252646 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.252955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.253546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.255452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:35.266472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:35.267510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:35.273035 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 331/661] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:35.274459 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.346628 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e888-196e-453a-8a2f-a29eb1400f46 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.383728 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2fe22-164e-4a2f-901f-ea2a885f5fc4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.384620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.385448 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.385880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.386314 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] PATH_INFO: `/v3/services/network` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.386962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.388344 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:35.397923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:35.398956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:35.399800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:35.403887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 331/662] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:35.404759 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.405045 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:35.425948 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.426677 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.427039 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.427384 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.428101 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:35.428462 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.429936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.433876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:35.434557 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 332/663] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:35.435174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.523617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424685-77c6-44ea-a617-e37353b35e1f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.542676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf88d8-d6da-441f-8cfa-69e27e9d8745 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.564471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.565317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.565754 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.566027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.566783 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] RBAC: Adding query filter params (name=image) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:35.567088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.569118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.573622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 332/664] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:35.574413 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.586219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.587514 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.588008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.588489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.589397 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] RBAC: Adding query filter params (name=network) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:35.589915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.591644 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.596974 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 333/665] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:35.598363 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.651360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:35.680672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:35.690658 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e3190-6c79-4b94-809e-65aede248e0b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.713892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bd021-57ab-4b57-aa7e-4b1622b1ba2d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.725680 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.726551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.726828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.727103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.727728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:35.728029 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.729417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.734757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 333/666] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:35.735550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:35.753049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.754072 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.754545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.755571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.756592 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] RBAC: Adding query filter params (type=image) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:35.756943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.758378 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157c00d-9786-4acb-9c68-b819f8430e0a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.768745 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 334/667] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:35.889308 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7318-bd07-4b18-8af3-a30512a4f4b5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:35.930798 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:35.931443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:35.931730 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:35.932010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:35.932698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:35.933022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:35.934471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060af6a-9e3e-4114-b3a8-7a9d64cc37b1 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:35.940278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 334/668] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:14:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:36.459863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88dd7d-8ae7-4584-8988-e0b9dbf4cf49 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:36.460267 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88dd7d-8ae7-4584-8988-e0b9dbf4cf49 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:36.460466 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88dd7d-8ae7-4584-8988-e0b9dbf4cf49 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:36.462085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 335/669] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:36.467488 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:36.467959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:36.468037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:36.487370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:36.488577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:36.503347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:36.559927 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 335/670] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:36.900802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88dd7d-8ae7-4584-8988-e0b9dbf4cf49 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:37.009590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88dd7d-8ae7-4584-8988-e0b9dbf4cf49 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:37.019911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:37.045735 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:37.046371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:37.046653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:37.046934 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:37.060528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:37.066338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:37.068113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:37.069095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 336/671] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:37.073989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:37.189804 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6196-d9ce-4556-bd50-01bdfa8c59c2 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:37.349222 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:37.350145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:37.350611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:37.351350 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:37.352211 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:37.352713 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:37.354386 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:37.363429 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 336/672] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:37.369433 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:37.470862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cc261-5e93-46f5-b525-2d716fac6f34 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:37.508363 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:37.509023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:37.509301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:37.509592 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:37.520353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:37.521869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:37.537584 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:37.538610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:37.539493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:37.539493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:37.539493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:37.539493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 337/673] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:37.544631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:37.561954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:37.655073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da052e3-bfe7-4415-a608-e624b1740fb5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:37.692109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:37.693380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:37.693380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:37.693380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:37.693963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:37.694269 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:37.695635 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:37.708083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 337/674] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:37.713337 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:37.737154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:37.823128 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1efee2-683e-43f0-b84d-875c88b8c248 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:37.864375 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:37.865391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:37.865872 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:37.866342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:37.874493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:37.876205 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:37.887812 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:37.888815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:37.889765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:37.892208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 338/675] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 18 19:14:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:37.898455 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:37.973331 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:38.014914 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d774b-e965-482a-9710-6530c30119bd None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.053293 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.053910 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.054256 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.054538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.055279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:38.055581 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:38.057048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2286-f1a6-4acb-a13d-e7de566c173b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:38.076174 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 338/676] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 18 19:14:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:38.081486 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.137827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617489f-1903-4cdd-bb2f-cb0c865f9059 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.138144 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617489f-1903-4cdd-bb2f-cb0c865f9059 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.138744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617489f-1903-4cdd-bb2f-cb0c865f9059 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.140944 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 339/677] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:14:38.148858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa3c3-b9fe-4fa6-b90f-ce042078d9a4 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.149228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa3c3-b9fe-4fa6-b90f-ce042078d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.149576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa3c3-b9fe-4fa6-b90f-ce042078d9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.173350 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-101aa3c3-b9fe-4fa6-b90f-ce042078d9a4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:38.175002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-101aa3c3-b9fe-4fa6-b90f-ce042078d9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:38.181633 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:38.204145 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eec5-9e57-4f62-bdc6-c5fb1e1d7f99 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.245258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.245903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.246189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.246624 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.256726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 340/678] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:38.258402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff099ca-8724-4432-aed8-bd371c4dbb86 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.259176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff099ca-8724-4432-aed8-bd371c4dbb86 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.259176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff099ca-8724-4432-aed8-bd371c4dbb86 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.261048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 341/679] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:38.261655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:38.263118 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:38.271377 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1810d4-d9f5-41ec-a800-d96e54d94f7e None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.272066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1810d4-d9f5-41ec-a800-d96e54d94f7e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.272549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1810d4-d9f5-41ec-a800-d96e54d94f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:38.280167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:38.281229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:38.286818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:38.286818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:38.286818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:38.286818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 339/680] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:38.288501 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.297880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-fe1810d4-d9f5-41ec-a800-d96e54d94f7e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:38.299375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-fe1810d4-d9f5-41ec-a800-d96e54d94f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:38.355547 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:38.370756 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 342/681] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:14:38.372019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5933fa-d608-4183-bc10-aebafd92e09e None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.372304 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5933fa-d608-4183-bc10-aebafd92e09e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.372576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5933fa-d608-4183-bc10-aebafd92e09e None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.376730 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 343/682] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:38.382223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.382511 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.382785 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.402419 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:38.403599 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:38.405698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45b4d-bf43-4b86-86ef-c6a327a1c2a4 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.436774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:38.442954 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.443926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.444395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.444955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.445816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:38.446304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:38.447856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:38.493176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 344/683] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:14:38.587612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 340/684] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:38.595668 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.605434 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.713349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81165a-6602-4738-8394-344f6a875095 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.733750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118f1f-1504-4592-9469-da9459dbcb69 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.751822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.752440 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.752753 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.752857 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:38.753036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.753681 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:38.755606 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:38.772988 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 341/685] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:14:38 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:14:38.774145 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.789289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.791108 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.791449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.791732 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.803230 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:38.805192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:38.823580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:38.824579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:38.825576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:38.829881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 345/686] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:38.832535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.854998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:38.918360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb984d1-4a29-44b7-924c-6f06c8262c45 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.953441 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd382b-dfca-4cf8-80f2-f04d6043810d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:38.964463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.965210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.965412 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.965641 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:38.966281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:38.967628 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:38.984442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 342/687] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:14:38 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:38.985383 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:38.997354 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:38.998490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:38.999056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:38.999613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:39.000595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:39.001129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:39.003548 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:39.020212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 346/688] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:39.028313 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:39.065742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:39.128373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe045-2abe-4c0b-93d1-342f43ee7b42 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:39.145499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:39.168302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe66a01-9acd-4921-960d-e7584105f53f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:39.185634 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78051ea5-de5f-4ab5-a004-2bbd5cd73526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:39.186547 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78051ea5-de5f-4ab5-a004-2bbd5cd73526 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:39.186838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78051ea5-de5f-4ab5-a004-2bbd5cd73526 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:39.187115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78051ea5-de5f-4ab5-a004-2bbd5cd73526 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:39.187760 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78051ea5-de5f-4ab5-a004-2bbd5cd73526 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:39.190085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78051ea5-de5f-4ab5-a004-2bbd5cd73526 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:39.209394 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 343/689] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:14:38 2022] POST /identity/v3/services => generated 240 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:39.229572 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43a4b-b0cd-439e-83e3-6680b14f9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:39.230742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43a4b-b0cd-439e-83e3-6680b14f9084 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:39.230742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43a4b-b0cd-439e-83e3-6680b14f9084 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:39.230742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43a4b-b0cd-439e-83e3-6680b14f9084 None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/1b3a5ebc5fe740ab818293c3c0b3c31b/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:39.233078 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43a4b-b0cd-439e-83e3-6680b14f9084 None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=1b3a5ebc5fe740ab818293c3c0b3c31b, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:39.234787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43a4b-b0cd-439e-83e3-6680b14f9084 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:39.255890 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 347/690] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:14:39 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/1b3a5ebc5fe740ab818293c3c0b3c31b/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:14:41.121776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e4702-9d91-409d-b3e3-cac055358ab4 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.122311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e4702-9d91-409d-b3e3-cac055358ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.122311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e4702-9d91-409d-b3e3-cac055358ab4 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.123886 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 344/691] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:41.129391 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75ab7-8c5c-42a0-b97a-25554d54a9d2 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.129879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75ab7-8c5c-42a0-b97a-25554d54a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.129983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75ab7-8c5c-42a0-b97a-25554d54a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.148917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-99a75ab7-8c5c-42a0-b97a-25554d54a9d2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:41.150135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-99a75ab7-8c5c-42a0-b97a-25554d54a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:41.224897 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 348/692] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:41.321942 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d231c6e-6d27-4526-be35-b5296cde29b7 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.322277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d231c6e-6d27-4526-be35-b5296cde29b7 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.322490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d231c6e-6d27-4526-be35-b5296cde29b7 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.324046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 345/693] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:41.329456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f396e8-e623-417e-ab63-1ae7bf7dcaf9 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.329737 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f396e8-e623-417e-ab63-1ae7bf7dcaf9 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.330009 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f396e8-e623-417e-ab63-1ae7bf7dcaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.349992 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-83f396e8-e623-417e-ab63-1ae7bf7dcaf9 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:41.351492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-83f396e8-e623-417e-ab63-1ae7bf7dcaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:41.365433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:41.428172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 349/694] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:41.514077 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c35e-1a12-4da8-93f4-7f1dc193acb8 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.514435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c35e-1a12-4da8-93f4-7f1dc193acb8 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.514624 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c35e-1a12-4da8-93f4-7f1dc193acb8 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.516191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 346/695] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:41.521898 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442675-0945-4103-9e32-92c872998c1c None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.522424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442675-0945-4103-9e32-92c872998c1c None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.522997 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442675-0945-4103-9e32-92c872998c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.535184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b152-2516-4c14-8133-d0a0e4135177 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.535494 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b152-2516-4c14-8133-d0a0e4135177 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.535736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b152-2516-4c14-8133-d0a0e4135177 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.537418 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 347/696] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:41.542159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-75442675-0945-4103-9e32-92c872998c1c None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:41.543355 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-75442675-0945-4103-9e32-92c872998c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:41.543847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.544337 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.544870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.564421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:41.566082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:41.617138 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 350/697] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:41.618046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442675-0945-4103-9e32-92c872998c1c None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:41.656317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 348/698] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:41.722696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:41.754412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442675-0945-4103-9e32-92c872998c1c None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:41.761800 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:41.806424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:41.807573 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.807969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.808246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] PATH_INFO: `/v3/services/image` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.808886 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:41.810431 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:41.822180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:41.823435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:41.824387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 351/699] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Aug 18 19:14:41 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:41.829978 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:41.890582 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e15d29-a101-4faf-8b1a-caf53717deac None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:41.892475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:41.929493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:41.930504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.930987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.931450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.932385 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:41.933954 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:41.940131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f341c7f-9e99-4ebc-8157-7a5ba68b8e30 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:41.943830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:41.944830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:41.945671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:41.948316 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 349/700] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Aug 18 19:14:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:41.956418 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:41.976850 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:41.977493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:41.977774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:41.978050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:41.978684 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] RBAC: Adding query filter params (name=image) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:41.978987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:41.980357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:41.984896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 352/701] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:41.985675 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:41.990486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.068186 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0b398-b843-4a59-8bde-c1622abd7de2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.086816 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1581-33c0-4bb8-a56c-1ca546740d71 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.102257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.102868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.103149 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.103421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.104082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.104379 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.105785 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.110305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 350/702] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 18 19:14:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.111103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.123866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.124505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.124821 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.125096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] PATH_INFO: `/v3/services/network` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.125681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.127038 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:42.135726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:42.137210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:42.138159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 353/703] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:41 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:42.139104 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.147916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.205894 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.219664 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa94b0-233a-4cb5-8df9-4875aa44dc86 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.240610 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97f695-d723-4e2b-85be-55080ce3fb7e None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.254549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.255154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.255438 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.255710 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.256457 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] RBAC: Adding query filter params (type=image) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.256790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.258313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.262951 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 351/704] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.263736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.274642 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.275216 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.275495 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.275819 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.286604 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:14:42.291220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:42.292439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:42.293407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 354/705] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:42.294137 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.361486 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.368674 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58f50-05e1-4cfd-8a6d-27eb0b8da555 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.394553 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e4968-1f9c-40ef-9ad2-1278d592f6bb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.403949 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.404562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.404869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.405144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.405775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.406082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.407419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.412799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 352/706] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.413488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.424793 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.432885 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.433495 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.433777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.434053 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.434679 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.434982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.436343 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.440942 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 355/707] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.441709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.514276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfcc14-9c7e-41ed-9bb4-05d62b692ad1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.542410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c271b-a723-4c8a-824b-c534f18675a8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.549423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.550040 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.550323 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.550599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.551302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] RBAC: Adding query filter params (interface=public, service_id=1fe2b7ed84784621aea5a49fe88c70a2, region_id=RegionOne) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.551655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.553062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.561474 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 353/708] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/endpoints?service_id=1fe2b7ed84784621aea5a49fe88c70a2&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.562329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.575997 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.576605 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.576928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.577206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.577867 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.578168 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.579520 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.593009 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 356/709] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.593923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.594069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.652915 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.669515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354776c-557d-443a-b9bb-7ba698fcda81 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.704139 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.704761 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.705041 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.705313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.706012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] RBAC: Adding query filter params (interface=public, service_id=e99e1284614a4ccb8e3dc560248c6139, region_id=RegionOne) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.706313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.707656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.708240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b860a-dd32-42d1-88a7-92d2e09f68b8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.712498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 354/710] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/endpoints?service_id=e99e1284614a4ccb8e3dc560248c6139&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.713299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.745423 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.746022 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.746299 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.746618 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.747186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] RBAC: Adding query filter params (type=network) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:42.747485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.748874 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.753516 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 357/711] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:42.754285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.802824 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.819688 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa755644-b2c6-4ddc-908b-a3d56106347a None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.854943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.855559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.855851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.856127 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.856771 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.858157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.858864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331bcbe-41f9-47b6-9929-947a1a47e206 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:42.864876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 355/712] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/services => generated 1002 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:14:42.865672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.877830 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:42.897927 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:42.898626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:42.898993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:42.899203 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:42.912772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:42.914238 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:42.931959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:42.933224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:42.934449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:42.934449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:42.934449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:42.934449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 358/713] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:42.934449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:42.999174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2ef7-90d6-49a5-a064-2d40b4abc64c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.039706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.040325 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.040743 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.041023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.041674 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.043020 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:43.047576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ebe67-2ca1-4d8e-8643-3fd7dec5d5ea None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.052982 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 356/714] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/services => generated 1002 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:14:43.054256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:43.075641 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:43.095118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.096096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.096571 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.097033 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.097899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] RBAC: Adding query filter params (interface=public, service_id=888da1fcd8b04d1bbc146e979ce46a0c, region_id=RegionOne) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:43.098401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.100537 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:43.111146 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 359/715] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:14:42 2022] GET /identity/v3/endpoints?service_id=888da1fcd8b04d1bbc146e979ce46a0c&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:43.116494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:43.157814 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:43.217918 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787324-680c-4793-8e93-ea811a85968e None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.243949 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eea8f7-0a8f-4ffe-a443-49d5365e7df8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.265604 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.266212 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.266492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.266764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.267410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:43.267708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.269085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:43.284110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 357/716] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:43.290804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:43.294768 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.296278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.296565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.296878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.297498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.298892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:43.306098 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 360/717] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:14:43 2022] GET /identity/v3/services => generated 1002 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 19:14:43.382407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:43.414442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374fe89-fb90-4e54-b9fb-844bb78e402f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.455652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.456408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.456716 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.457005 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.466205 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.467842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:14:43.485769 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:43.486858 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:14:43.487819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:43.492451 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 358/718] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 18 19:14:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:43.493411 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:43.610594 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:43.617387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897450d7-aef2-4244-8b52-a46ef8cdc2c5 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.652542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.653176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.653454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.653726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.654452 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:43.654750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.656173 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:43.674092 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 361/719] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 18 19:14:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:43.679396 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:43.787487 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf5254-1b96-4c2f-a383-68169d6aa933 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:43.825019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:43.825680 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:43.825972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:43.826252 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:43.829044 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:43.901477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:43.902846 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:44.008172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 359/720] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:43 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:14:44.013772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:44.128167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00fd0f-3325-458d-9bc7-e6eef5a00c71 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:44.165081 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:44.166501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:44.167001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:44.167479 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:44.179250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:44.180999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:44.197090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:44.198112 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:44.199151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:44.199151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:44.199151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:44.202359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 362/721] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:44.208067 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:44.246989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:44.318815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e3ad5-f054-4869-880b-85997190894d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:44.354808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:44.355405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:44.355689 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:44.355959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:44.356599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:44.356932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:44.358286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:44.370707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 360/722] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:44.375938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:44.387636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:44.485435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317bab-5c9b-4a8c-af88-4030382fd244 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:44.528199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:44.529274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:44.529769 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:44.530257 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:44.539257 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:44.541164 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:14:44.555536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:44.556493 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:14:44.557438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:44.564895 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 363/723] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:44.566881 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:44.677310 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:44.684027 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d4713-8aa6-4c1c-a6e7-c9d0483ff1da None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:44.727908 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:44.728531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:44.728892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:44.729171 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:44.729868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:44.730177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:44.731589 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0026a-ac6e-4735-8c1b-58f9c604d4b9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:44.745327 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 361/724] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:44.751352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:44.827098 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:44.865463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98988128-30ae-40e2-a663-d6110aa0b28f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:44.901857 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:44.902722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:44.903157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:44.903582 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:44.904458 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=1b3a5ebc5fe740ab818293c3c0b3c31b) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:44.904988 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:44.906580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c1a9-d6e6-4a57-806d-b82d2ce13f4a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:44.913348 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 364/725] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:14:44 2022] GET /identity/v3/role_assignments?user.id=1b3a5ebc5fe740ab818293c3c0b3c31b&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:45.229854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2967929-cff7-47d9-8941-0657aad1247f None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.230139 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2967929-cff7-47d9-8941-0657aad1247f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.230526 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2967929-cff7-47d9-8941-0657aad1247f None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.232117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 362/726] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:45.237459 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe7ba-cbc9-4579-a089-2e04dcddc40a None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.237936 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe7ba-cbc9-4579-a089-2e04dcddc40a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.238015 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe7ba-cbc9-4579-a089-2e04dcddc40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.257296 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-9cebe7ba-cbc9-4579-a089-2e04dcddc40a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:45.258492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-9cebe7ba-cbc9-4579-a089-2e04dcddc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:45.335555 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 365/727] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:45.458053 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a38f-6649-46ae-ad87-3ff7101321b2 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.458578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a38f-6649-46ae-ad87-3ff7101321b2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.458578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a38f-6649-46ae-ad87-3ff7101321b2 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.459918 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 363/728] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:45.465508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8c0c-156c-4700-bdaa-541f77a2232b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.465797 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8c0c-156c-4700-bdaa-541f77a2232b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.466077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8c0c-156c-4700-bdaa-541f77a2232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.487582 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-d0bf8c0c-156c-4700-bdaa-541f77a2232b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:45.489687 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-d0bf8c0c-156c-4700-bdaa-541f77a2232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:45.553767 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:45.566786 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 366/729] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:45.671200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a38f-6649-46ae-ad87-3ff7101321b2 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:45.708790 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43308a22-f727-400d-816f-3564fba3cc44 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.709091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43308a22-f727-400d-816f-3564fba3cc44 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.709342 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43308a22-f727-400d-816f-3564fba3cc44 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.710902 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 367/730] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:45.715834 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.716118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.716395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.735740 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:45.737416 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:45.784713 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a38f-6649-46ae-ad87-3ff7101321b2 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:45.822725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:45.823442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:45.823950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:45.824292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] PATH_INFO: `/v3/services/image` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:45.825057 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:45.826535 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:45.826899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 368/731] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:45.844543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:45.845663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:45.846923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 364/732] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Aug 18 19:14:45 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:45.852333 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:45.918139 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:45.939866 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:45.968142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab7e34-497e-4d82-a417-878e52da3b06 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:45.997714 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:46.010943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.011907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.012400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.012907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.013760 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] RBAC: Adding query filter params (name=image) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:46.014266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.016322 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.023224 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 369/733] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:46.030758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.048863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db154fd5-9368-4311-b4da-1d9279c1b624 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.085365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.085927 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.086214 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.086490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.087085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.088518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:46.097518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:46.099143 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:46.105314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 365/734] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Aug 18 19:14:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:46.107181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.165630 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a83a5-7297-45ba-abaa-3bb751981226 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.197703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:46.202562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.203258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.203632 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.203984 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.204712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] RBAC: Adding query filter params (type=image) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:46.205116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.206564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.212373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 370/735] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:46.217602 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a26e3d-760f-45d1-9309-e4b7e5d48854 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.219290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.253862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.254601 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.255458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.255803 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.256496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:46.256879 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.258228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.267399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 366/736] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 18 19:14:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:46.267399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.276395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:46.328462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de858a3-a8af-4cbf-a920-189e7ffd868a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.364517 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.365278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.365559 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.365836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] PATH_INFO: `/v3/services/network` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.366417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.367777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:46.376415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:46.377472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:46.378325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 371/737] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:14:46 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:46.379154 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.388965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1361757-58d8-4673-8362-9d14d7fc8230 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.423573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.424407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.424706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.424980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.425634 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.427482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.452248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 367/738] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:14:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:46.453388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.456216 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:46.505794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e62cbc-aa34-49cd-be05-a2bad690fd97 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.523491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:46.557480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.558505 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.558892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.559263 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.560082 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:46.560468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.562020 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.580183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 372/739] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 18 19:14:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:46.582353 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.620360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7ab8-57eb-4b92-bd3c-303f53190efb None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.661615 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.662339 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.662690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.663056 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.663908 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] RBAC: Adding query filter params (name=network) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:46.664225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.665780 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.675728 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 368/740] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:14:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:46.677700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.723540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0fd9-241f-4909-a11d-10e4cf9ba4c3 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.759981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.760599 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.760923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.761212 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.761878 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.763255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.769806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:46.792869 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 373/741] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:14:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:14:46.834980 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac941dba-6e27-4bff-a4d0-228cb1c9acc6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:46.909762 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:46.910822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:46.911401 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:46.911905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:46.913006 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:46.913565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:46.915203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9227ee-58b8-4120-82be-4ad17105d9e7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:46.924862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 369/742] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:14:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:46.929289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:46.968162 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:47.049503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e49f-d2e6-4646-ae20-8d12e976f3fc None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:47.086631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0057f7c-1299-4c61-bfa8-cc53e9f41495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:47.087335 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0057f7c-1299-4c61-bfa8-cc53e9f41495 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:47.087720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0057f7c-1299-4c61-bfa8-cc53e9f41495 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:47.088089 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0057f7c-1299-4c61-bfa8-cc53e9f41495 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:47.089071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0057f7c-1299-4c61-bfa8-cc53e9f41495 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:47.090795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0057f7c-1299-4c61-bfa8-cc53e9f41495 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:47.118569 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 374/743] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:14:46 2022] POST /identity/v3/endpoints => generated 337 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:47.289715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675e3c-4792-4d80-8e84-b487a5f3f0e0 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:47.290317 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675e3c-4792-4d80-8e84-b487a5f3f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:47.290709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675e3c-4792-4d80-8e84-b487a5f3f0e0 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:47.292123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 370/744] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:47.297964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:47.298449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:47.298557 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:47.318781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:47.319981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:47.397348 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 375/745] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:47.722496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675e3c-4792-4d80-8e84-b487a5f3f0e0 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:47.834408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675e3c-4792-4d80-8e84-b487a5f3f0e0 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:47.865315 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:47.875366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:47.876068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:47.876354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:47.876630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:47.877255 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:47.878611 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:47.887443 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:47.888446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:47.889402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:47.890938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 371/746] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Aug 18 19:14:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:47.894404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:47.909523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:48.003251 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b114-55f4-416a-9b3c-65c12c5477ec None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:48.038776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:48.039533 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:48.039917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:48.040296 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:48.041157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:48.041559 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:48.043034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bacc4-4c8e-4199-8bf5-539a3a1d7ae9 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:48.047841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 376/747] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 18 19:14:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:48.053470 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:48.157768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3d832-9a68-438c-82f9-1706f17178c1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:48.193491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:48.194363 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:48.194767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:48.195160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:48.195883 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:48.196286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:48.197893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f22d-3f22-4f62-b313-1195517a0c2d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:48.208744 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 372/748] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 18 19:14:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:48.808051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6889-d019-4383-993d-eccc69de18b7 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:48.808606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6889-d019-4383-993d-eccc69de18b7 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:48.808606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6889-d019-4383-993d-eccc69de18b7 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:48.809986 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 377/749] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:48.815124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8163d-b9d7-4693-b3ca-38932ca6fdc5 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:48.815531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8163d-b9d7-4693-b3ca-38932ca6fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:48.815728 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8163d-b9d7-4693-b3ca-38932ca6fdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:48.833714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-79b8163d-b9d7-4693-b3ca-38932ca6fdc5 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:48.834901 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-79b8163d-b9d7-4693-b3ca-38932ca6fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:48.888790 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:48.907685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 373/750] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:48 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:49.107948 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069161-a3c4-4bcf-8e50-5d1ac46cd98c None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.108426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069161-a3c4-4bcf-8e50-5d1ac46cd98c None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.108547 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069161-a3c4-4bcf-8e50-5d1ac46cd98c None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.109995 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 378/751] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:49.116085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.116374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.116653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.134835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:49.136427 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:49.215924 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 374/752] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:49 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:49.229336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069161-a3c4-4bcf-8e50-5d1ac46cd98c None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:49.313043 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:49.339030 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069161-a3c4-4bcf-8e50-5d1ac46cd98c None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:49.373344 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:49.373946 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.374229 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.374503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.441430 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:49.443344 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:49.528475 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:49.553304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:49.556900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 379/753] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:14:49 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:14:49.559546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:49.668566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcf192-4b57-4563-9850-e95519d0859f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:49.669257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60b59c-6428-4d48-87c5-17bf1f64f019 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:49.684895 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:49.705167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:49.705621 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:49.705803 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.706179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.706369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.706478 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.706633 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.706869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.707457 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:49.708897 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:49.717010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:49.717652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:49.718699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:49.721826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:49.722602 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:49.722690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 375/754] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:49.725005 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:14:49.738309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:49.739542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:14:49.740462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:14:49.740462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:14:49.740462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:49.740462 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 380/755] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:14:49.745213 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:49.775387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:49.837545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab3d8-0698-467d-addf-ffab6fe060c2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:49.858684 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e549-8830-4a2d-8403-f36232a00bc1 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:49.872468 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:49.873113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.873400 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.873675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.874330 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:49.874634 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:49.876017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:49.881083 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 376/756] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:49.886660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:49.904201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:49.904842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:49.905127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:49.905395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:49.906041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:49.906455 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:49.907934 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987337c-8c79-43d6-aade-9bcdca8192ea None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:49.929232 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 381/757] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:49.933514 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:50.001990 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670e85e-7120-4022-9bcc-c111d5262949 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:50.039298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:50.039925 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:50.040207 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:50.040484 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:50.041172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:50.041478 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:50.042851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92503b-1615-4c44-90e2-90142bed2865 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:50.048198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 377/758] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:50.413892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f13e0-1351-43d4-9a90-c0efdd63611d None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:50.414196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f13e0-1351-43d4-9a90-c0efdd63611d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:50.414472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f13e0-1351-43d4-9a90-c0efdd63611d None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:50.415784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 382/759] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:50.421112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c751-ad39-41c7-9b54-2025f3367850 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:50.421402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c751-ad39-41c7-9b54-2025f3367850 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:50.421678 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c751-ad39-41c7-9b54-2025f3367850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:50.439428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-e7e7c751-ad39-41c7-9b54-2025f3367850 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:50.440602 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-e7e7c751-ad39-41c7-9b54-2025f3367850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:50.506095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 378/760] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:50.840409 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f13e0-1351-43d4-9a90-c0efdd63611d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:50.927314 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:50.941233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f13e0-1351-43d4-9a90-c0efdd63611d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:50.974623 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2363e0-86c4-4828-baa2-f0631063ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:50.975219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2363e0-86c4-4828-baa2-f0631063ec10 None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:50.975501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2363e0-86c4-4828-baa2-f0631063ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:50.975769 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2363e0-86c4-4828-baa2-f0631063ec10 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:50.976648 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2363e0-86c4-4828-baa2-f0631063ec10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:50.978033 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2363e0-86c4-4828-baa2-f0631063ec10 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:50.993713 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 383/761] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:14:50 2022] POST /identity/v3/services => generated 269 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:52.256136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a45aa1-c064-4e99-b2a7-f8bd074066f6 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:52.256723 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a45aa1-c064-4e99-b2a7-f8bd074066f6 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:52.256723 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a45aa1-c064-4e99-b2a7-f8bd074066f6 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:52.258037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 379/762] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:52.263486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689e57-b682-4351-9031-4d7e8a2d43d2 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:52.263929 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689e57-b682-4351-9031-4d7e8a2d43d2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:52.264051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689e57-b682-4351-9031-4d7e8a2d43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:52.284130 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-0c689e57-b682-4351-9031-4d7e8a2d43d2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:52.285345 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-0c689e57-b682-4351-9031-4d7e8a2d43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:52.357965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 384/763] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:52 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:52.688838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a45aa1-c064-4e99-b2a7-f8bd074066f6 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:52.725123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:52.796367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a45aa1-c064-4e99-b2a7-f8bd074066f6 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:52.831067 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526ae39-6009-4cb7-8124-d8d743c64cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:52.831682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ae39-6009-4cb7-8124-d8d743c64cb7 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:52.831966 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ae39-6009-4cb7-8124-d8d743c64cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:52.832243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ae39-6009-4cb7-8124-d8d743c64cb7 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:52.833459 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526ae39-6009-4cb7-8124-d8d743c64cb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:52.834820 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526ae39-6009-4cb7-8124-d8d743c64cb7 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:52.850399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 380/764] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:14:52 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:53.191351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459437-97f8-4e99-9ff2-1e77512c3ded None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:53.191661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459437-97f8-4e99-9ff2-1e77512c3ded None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:53.192451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459437-97f8-4e99-9ff2-1e77512c3ded None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:53.193860 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 385/765] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:53.199425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:53.199715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:53.199992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:53.218546 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:53.219718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:53.296307 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 381/766] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:53.627597 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459437-97f8-4e99-9ff2-1e77512c3ded None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:53.700928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:53.728367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459437-97f8-4e99-9ff2-1e77512c3ded None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:53.761209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:53.761838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:53.762121 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:53.762399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:53.762984 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:53.764349 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:53.773613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:53.774715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:53.775677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 386/767] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Aug 18 19:14:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:53.780702 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:53.807957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:53.887240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8866-0832-4538-800c-2c0aaccff07a None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:53.921869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:53.922472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:53.922752 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:53.923019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:53.923650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:53.923944 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:53.925310 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:53.930003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 382/768] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 18 19:14:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:53.935676 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:54.037947 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bf50d-bd60-4729-97bc-18ea575653a4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:54.070059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:54.070652 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:54.070928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:54.071200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:54.071826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:54.072125 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:54.073512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:54.078061 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 387/769] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 18 19:14:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:54.084811 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:54.167168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:54.182427 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62603ab-986b-4772-b5f9-bc8bc38c3215 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:54.215441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:54.216073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:54.216354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:54.216627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:54.217357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] RBAC: Adding query filter params (interface=public, service_id=8e84baf1057347a8a8950d2ce3aa65c5, region_id=RegionOne) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:54.217663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:54.219005 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c2f29-8045-4d60-9cd4-5543ff8d5020 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:54.224371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 383/770] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:14:54 2022] GET /identity/v3/endpoints?service_id=8e84baf1057347a8a8950d2ce3aa65c5&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:54.230367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:54.233442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:54.329863 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abcd1c-ecbb-4326-8fc9-45cade6e9906 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:54.363010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a481954-77bf-45ff-8ff3-38fe70e82467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:54.363607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a481954-77bf-45ff-8ff3-38fe70e82467 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:54.363907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a481954-77bf-45ff-8ff3-38fe70e82467 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:54.364176 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a481954-77bf-45ff-8ff3-38fe70e82467 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:54.364831 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a481954-77bf-45ff-8ff3-38fe70e82467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:54.366188 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a481954-77bf-45ff-8ff3-38fe70e82467 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:54.371985 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 388/771] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:14:54 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:14:55.065591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff461d-e6e9-47f1-9f08-f376c3973c43 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:55.066114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff461d-e6e9-47f1-9f08-f376c3973c43 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:55.066114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff461d-e6e9-47f1-9f08-f376c3973c43 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:55.067380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 384/772] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:55.072736 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:55.073177 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:55.073405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:55.091693 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:55.092887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:55.150607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:55.158362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 389/773] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:55 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:55.487682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff461d-e6e9-47f1-9f08-f376c3973c43 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:55.594709 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff461d-e6e9-47f1-9f08-f376c3973c43 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:55.629868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:55.630504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:55.630787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:55.631067 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:55.631690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:55.633110 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:55.641585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:55.642605 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:14:55.643827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 385/774] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:55.648595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:55.745012 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e78a8-ed71-4931-99be-8b9b69d2422f None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:55.778395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:55.779004 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:55.779287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:55.779559 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:55.780190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:55.780492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:55.781926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:55.787131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 390/775] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:55.792950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:55.809695 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:55.898078 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6355-58b2-470f-9c67-b0aa000c416b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:55.930893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:55.931496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:55.931776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:55.932050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:55.932704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:55.933014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:55.934365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:55.939243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 386/776] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:55.945259 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:56.003673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:56.044127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69977-cbef-49d7-8029-7320aa0e2ffa None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:56.076337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:56.077039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:56.077240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:56.077513 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:56.078209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] RBAC: Adding query filter params (interface=public, service_id=4b69cd907a1140cd9d728dc99c901b5d, region_id=RegionOne) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:56.078515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:56.079877 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913760e-e1fd-4933-b3f8-8134d4349e61 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:56.085411 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 391/777] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:14:55 2022] GET /identity/v3/endpoints?service_id=4b69cd907a1140cd9d728dc99c901b5d&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:56.091130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:56.169936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:56.192706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36d8a-df78-435f-b2c9-cf7f1e7620f0 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:56.226766 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c98032-fcb5-46e3-b4b7-6a6a59511ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:56.227371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98032-fcb5-46e3-b4b7-6a6a59511ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:56.227654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98032-fcb5-46e3-b4b7-6a6a59511ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:56.227928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98032-fcb5-46e3-b4b7-6a6a59511ee1 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:56.228534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98032-fcb5-46e3-b4b7-6a6a59511ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:56.229911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98032-fcb5-46e3-b4b7-6a6a59511ee1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:56.235847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 387/778] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:14:56 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:14:56.542913 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa87f-2891-4d28-af51-18decd4b59f2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:56.543200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa87f-2891-4d28-af51-18decd4b59f2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:56.543484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa87f-2891-4d28-af51-18decd4b59f2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:56.544828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 392/779] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:56.550042 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:56.550332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:56.550612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:56.568612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:56.569823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:56.640076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 388/780] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:56.969155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa87f-2891-4d28-af51-18decd4b59f2 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:57.071340 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa87f-2891-4d28-af51-18decd4b59f2 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:57.094100 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:57.105993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:57.106623 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:57.106904 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:57.107186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:57.107761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:57.109173 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:57.119278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:57.120356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:57.121802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 393/781] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Aug 18 19:14:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:57.126346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:57.194777 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:57.225311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793cd45-4a90-4647-85f8-8d7eb032a1c0 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:57.263648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:57.264257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:57.264539 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:57.264843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:57.265480 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:57.265780 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:57.267129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:57.272541 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 389/782] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 18 19:14:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:57.278245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:57.380688 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232681c-755d-4084-aa56-feff8ce568af None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:57.413392 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:57.413997 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:57.414275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:57.414549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:57.415207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:57.415509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:57.416902 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6dde5-47e4-4fb7-8ad6-c7c91c79a658 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:57.422250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 394/783] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 18 19:14:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:14:57.427991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:57.526977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781c7aa-cb4d-4168-b60e-70a1de858437 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:57.561084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e68c-24a2-4d68-bba3-2503eb69dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:57.561680 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e68c-24a2-4d68-bba3-2503eb69dedf None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:57.561963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e68c-24a2-4d68-bba3-2503eb69dedf None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:57.562236 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e68c-24a2-4d68-bba3-2503eb69dedf None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:57.562899 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e68c-24a2-4d68-bba3-2503eb69dedf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:57.564238 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e68c-24a2-4d68-bba3-2503eb69dedf None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:57.570084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:57.585176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 390/784] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:14:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:58.456029 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6159b7-73b5-47fe-99dc-a2973add77e0 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:58.456601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6159b7-73b5-47fe-99dc-a2973add77e0 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:58.456601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6159b7-73b5-47fe-99dc-a2973add77e0 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:58.457953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 395/785] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:58.463144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:58.463567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:58.463697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:58.482715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:58.484247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:58.560202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 391/786] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:14:58.888186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6159b7-73b5-47fe-99dc-a2973add77e0 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:58.942627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:58.989821 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6159b7-73b5-47fe-99dc-a2973add77e0 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:59.023019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:59.023639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:59.023917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:59.024187 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:59.024787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:59.026139 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:14:59.034612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:14:59.040899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:14:59.041812 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 396/787] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:14:59.042665 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:59.142134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434f50c-2f48-4435-b237-4474bda67e6f None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:59.159707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:59.178419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:59.179164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:59.179441 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:59.179708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:59.180336 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:59.180635 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:59.182014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:59.186818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 392/788] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:59.193217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:59.304466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb958c9-3790-43dc-b9db-c74923b5640f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:59.321436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:59.339751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:59.340353 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:59.340629 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:59.340998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:59.341621 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:14:59.341920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:59.343275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be85de-90c8-4aae-87ab-67b1568a1b73 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:59.352954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 397/789] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 18 19:14:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:14:59.354156 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:14:59.451515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c2a43-f31f-4fb7-967f-cde1c79a8ebf None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:14:59.485361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c674-1699-42dc-a022-d0b74b874b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:14:59.486197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c674-1699-42dc-a022-d0b74b874b26 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:59.486485 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c674-1699-42dc-a022-d0b74b874b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:59.486888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c674-1699-42dc-a022-d0b74b874b26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:59.487674 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c674-1699-42dc-a022-d0b74b874b26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:14:59.489315 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c674-1699-42dc-a022-d0b74b874b26 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:14:59.510746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 393/790] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:14:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:14:59.800717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d594-bf28-4f97-851b-f9f1b1cfadf3 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:59.801778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d594-bf28-4f97-851b-f9f1b1cfadf3 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:59.801778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d594-bf28-4f97-851b-f9f1b1cfadf3 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:59.803063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 398/791] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:14:59.808475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f215be-787a-400e-a502-b12eb961981b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:14:59.808796 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f215be-787a-400e-a502-b12eb961981b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:14:59.809076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f215be-787a-400e-a502-b12eb961981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:14:59.827987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-d4f215be-787a-400e-a502-b12eb961981b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:14:59.829213 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d4f215be-787a-400e-a502-b12eb961981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:14:59.858338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:14:59.903433 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 394/792] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:14:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:15:00.228562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d594-bf28-4f97-851b-f9f1b1cfadf3 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:00.325673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d594-bf28-4f97-851b-f9f1b1cfadf3 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:00.359992 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:00.360607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:00.360913 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:00.361186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] PATH_INFO: `/v3/services/compute` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:00.361758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:00.363115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:00.371651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:15:00.373346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:00.374227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 399/793] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:15:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:15:00.378870 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f215be-787a-400e-a502-b12eb961981b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:00.476896 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f215be-787a-400e-a502-b12eb961981b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:00.509891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:00.510522 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:00.510679 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:00.510949 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:00.511575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:00.511873 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:00.513276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083dee-283d-40ee-a95a-9e4a880deb76 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:00.517979 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 395/794] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:00.524540 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:00.570000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:00.636523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1c792-d8f6-4296-b446-e9675df6fefb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:00.676239 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:00.676886 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:00.677165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:00.677437 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:00.678064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] RBAC: Adding query filter params (type=compute) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:00.678363 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:00.679713 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830eb6d-557b-4c9d-a921-9a86bb556cca None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:00.684217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 400/795] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:01.774103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2b890-f8a7-4049-b905-3fedfa135aab None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:01.774691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2b890-f8a7-4049-b905-3fedfa135aab None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:01.774691 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2b890-f8a7-4049-b905-3fedfa135aab None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:01.775991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 396/796] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:15:01.782362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:01.782843 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:01.783326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:01.810810 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:15:01.812169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:15:01.886167 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 401/797] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:15:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:15:02.208223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2b890-f8a7-4049-b905-3fedfa135aab None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:02.237637 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:02.312583 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2b890-f8a7-4049-b905-3fedfa135aab None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:02.347693 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:02.348318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:02.348595 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:02.348893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:02.349516 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:02.350919 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:02.353756 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING keystone.server.flask.common [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 19:15:02.370571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.sql.core [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 19:15:02.370571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 19:15:02.370571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [parameters: {'id': '1504ea5dfcf64d50a2f2357d7d7eda81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 19:15:02.370571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88222) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1504ea5dfcf64d50a2f2357d7d7eda81.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1504ea5dfcf64d50a2f2357d7d7eda81. Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:15:02.387778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result.read() Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 19:15:02.388787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application yield resource Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise self.value Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application session.commit() Aug 18 19:15:02.389797 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.session.flush() Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application compat.raise_( Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 19:15:02.390717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 19:15:02.391676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result.read() Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:15:02.392512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [parameters: {'id': '1504ea5dfcf64d50a2f2357d7d7eda81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:02.393435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:02.394251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1504ea5dfcf64d50a2f2357d7d7eda81. Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:02.395750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 397/798] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Aug 18 19:15:02 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:15:02.396294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:02.435549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:02.494529 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6426a9-0db2-4ea2-a3b7-ff2adb9df291 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:02.528299 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:02.528943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:02.529220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:02.529563 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:02.536325 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:02.537798 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-31e0a886-18ee-4294-9b57-42128637cf8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:15:02.549398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:15:02.550326 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:02.551741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 402/799] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:15:02.557069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:02.646731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:02.663239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d93ef-a532-45ee-84cd-de1ced3c4113 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:02.697177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:02.697787 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:02.698062 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:02.698333 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:02.698991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:02.699291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:02.700943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5029342-d801-45a0-8d32-85a8bd557692 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:02.720198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 398/800] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:02.910376 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375065ed-7dc5-4d66-b208-7c74197c7e49 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:02.910963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375065ed-7dc5-4d66-b208-7c74197c7e49 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:02.910963 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375065ed-7dc5-4d66-b208-7c74197c7e49 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:02.912300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 403/801] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:15:02.918113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0f827-2ff3-4492-a0b2-501934c6f190 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:02.918630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0f827-2ff3-4492-a0b2-501934c6f190 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:02.918720 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0f827-2ff3-4492-a0b2-501934c6f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:02.938630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-2aa0f827-2ff3-4492-a0b2-501934c6f190 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:15:02.940201 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-2aa0f827-2ff3-4492-a0b2-501934c6f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:15:03.009405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 399/802] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:15:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:15:03.346487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375065ed-7dc5-4d66-b208-7c74197c7e49 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:03.440907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:03.446364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375065ed-7dc5-4d66-b208-7c74197c7e49 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:03.480077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0cd7c-757c-4886-801b-981a3cc4c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:03.480700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cd7c-757c-4886-801b-981a3cc4c9cf None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:03.480983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cd7c-757c-4886-801b-981a3cc4c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:03.481253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cd7c-757c-4886-801b-981a3cc4c9cf None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:03.481881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0cd7c-757c-4886-801b-981a3cc4c9cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:03.483247 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0cd7c-757c-4886-801b-981a3cc4c9cf None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:03.499305 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 404/803] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:15:03 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:15:04.971304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef429275-b479-4a1d-bd07-2ec9b110d22a None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:04.971841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef429275-b479-4a1d-bd07-2ec9b110d22a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:04.971841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef429275-b479-4a1d-bd07-2ec9b110d22a None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:04.973695 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 400/804] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:15:04.979228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:04.979640 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:04.979778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:04.999125 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:15:05.000332 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:15:05.080827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 405/805] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:15:04 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:15:05.413825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef429275-b479-4a1d-bd07-2ec9b110d22a None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:05.489473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:05.515050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef429275-b479-4a1d-bd07-2ec9b110d22a None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:05.555453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:05.556073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:05.556355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:05.556631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:05.557319 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:05.558750 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:05.573844 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.sql.core [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 19:15:05.573844 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 19:15:05.573844 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [parameters: {'user_id': 'f04e59dfff4947078d4ef2bbbfbfa042', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 19:15:05.573844 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88222) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-7e333b59-9169-4f8a-a241-15c0decfeb3b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result.read() Aug 18 19:15:05.580268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:15:05.581342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application yield resource Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise self.value Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application session.commit() Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 19:15:05.583233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.session.flush() Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application compat.raise_( Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 19:15:05.584124 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:15:05.585064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application result.read() Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:15:05.585926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f04e59dfff4947078d4ef2bbbfbfa042', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:05.587986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 19:15:05.589590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:05.591080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 401/806] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 18 19:15:05 2022] POST /identity/v3/users => generated 160 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:15:05.591557 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:05.673875 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:05.689429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5af1ac-17b7-429b-8653-c346d03b89c3 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:05.690524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5af1ac-17b7-429b-8653-c346d03b89c3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:05.690807 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5af1ac-17b7-429b-8653-c346d03b89c3 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:05.691846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d839fbb-7685-4db9-a87a-7e756c46c493 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:05.695126 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 402/807] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:15:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:15:05.700201 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:05.700489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:05.700798 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:05.720036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:15:05.721560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:15:05.725887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:05.726762 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:05.727039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:05.727306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:05.734316 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:05.735836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:15:05.746943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:15:05.747976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:05.749023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 406/808] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:15:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:15:05.753700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:05.789305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 403/809] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:15:05 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:15:05.856937 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d585-21cd-493e-9a79-dde5a38d9b05 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:05.888440 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:05.889069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:05.889346 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:05.889618 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:05.890303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:05.890602 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:05.892017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:05.926599 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 407/810] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 18 19:15:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:15:06.117039 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:06.183929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:06.220886 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c118bd4-15c7-4ec0-8298-fd30910f2edb None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:06.253692 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:06.254819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:06.255096 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:06.255368 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] PATH_INFO: `/v3/services/compute` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:06.255945 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:06.257442 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:06.265734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:15:06.266910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:15:06.268153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 404/811] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:15:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:15:06.273414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:06.276361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:06.370514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5337a2-9d24-493e-abd1-f1119e9e3f9c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:06.403649 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:06.404238 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:06.404514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:06.404816 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:06.405436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:06.405733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:06.407078 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:06.411623 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 408/812] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:06.417388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:06.515065 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500fc3-70d9-4b10-aa2c-18cd1cb8893c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:06.541781 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:06.547852 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:06.548452 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:06.548761 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:06.549040 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:06.549666 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:06.549969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:06.551807 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:06.556655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 405/813] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:06.562846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:06.627201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:06.661077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bef8c3-e316-4db6-a36c-1f38fef4ab4d None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:06.693652 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:06.694241 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:06.694519 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:06.694787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:06.695476 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] RBAC: Adding query filter params (interface=public, service_id=1dd41dfc0e614f969d8d08407889b1c3, region_id=RegionOne) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:06.695777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:06.697154 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6214dd0-0ed7-4421-8b0c-9c23f4eb5f49 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:06.701885 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 409/814] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:15:06 2022] GET /identity/v3/endpoints?service_id=1dd41dfc0e614f969d8d08407889b1c3&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:06.707660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:06.806263 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1239f-b40a-4370-8ec5-9193a825b393 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:06.839059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff086f1-13ef-4d34-8edd-d95bd2e2b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:06.839661 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff086f1-13ef-4d34-8edd-d95bd2e2b2ef None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:06.839941 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff086f1-13ef-4d34-8edd-d95bd2e2b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:06.840218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff086f1-13ef-4d34-8edd-d95bd2e2b2ef None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:06.840854 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff086f1-13ef-4d34-8edd-d95bd2e2b2ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:06.842196 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff086f1-13ef-4d34-8edd-d95bd2e2b2ef None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:06.848915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 406/815] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:15:06 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:15:09.025685 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bd6c9-2867-49f6-948d-7866eeafcb73 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:09.026209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bd6c9-2867-49f6-948d-7866eeafcb73 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:09.026209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bd6c9-2867-49f6-948d-7866eeafcb73 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:09.027464 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 410/816] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:15:09.032892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:09.033276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:09.033445 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:09.051121 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:15:09.052312 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:15:09.104552 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:09.118230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 407/817] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:15:09 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:15:09.449234 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bd6c9-2867-49f6-948d-7866eeafcb73 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:09.551844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bd6c9-2867-49f6-948d-7866eeafcb73 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:09.579192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:09.585463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:09.586118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:09.586400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:09.586672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] PATH_INFO: `/v3/services/compute` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:09.587253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:09.588625 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:15:09.597568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:15:09.598805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:15:09.599666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 411/818] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:15:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:15:09.605040 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:09.702117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35e93-7779-4cff-83aa-35589750ab3a None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:09.735597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:09.736190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:09.736466 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:09.736762 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:09.737386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] RBAC: Adding query filter params (name=compute) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:09.737686 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:09.739642 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:09.744233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 408/819] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:09.750066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:09.847211 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de24e51-82e9-40a7-b2bb-88aa724b9caf None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:09.880378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:09.880998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:09.881278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:09.881549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:09.882169 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:15:09.882469 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:09.883822 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eac777-7761-4200-a1cc-7c6c15bca256 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:09.888378 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 412/820] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 18 19:15:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:15:09.894477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:15:09.947304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:09.993601 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0d65e-2555-44ef-abb8-519a1938470c None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:15:10.025154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232a75-c567-408f-9a92-7d6f28481537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:15:10.025746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232a75-c567-408f-9a92-7d6f28481537 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:15:10.026024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232a75-c567-408f-9a92-7d6f28481537 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:15:10.026297 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232a75-c567-408f-9a92-7d6f28481537 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:15:10.026958 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232a75-c567-408f-9a92-7d6f28481537 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:15:10.028298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232a75-c567-408f-9a92-7d6f28481537 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:15:10.047742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 409/821] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:15:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:15:19.886140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=71 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:15:20.043508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:12.701674 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bcd5-2f5b-437d-8ae4-e09ce18a113f None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:12.702288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bcd5-2f5b-437d-8ae4-e09ce18a113f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:12.702288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bcd5-2f5b-437d-8ae4-e09ce18a113f None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:12.703866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 413/822] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:12.710005 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:12.710586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:12.710586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:12.730276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:12.731510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:12.827620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 410/823] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:12 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:16:13.157336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bcd5-2f5b-437d-8ae4-e09ce18a113f None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:13.319766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bcd5-2f5b-437d-8ae4-e09ce18a113f None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:13.375050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:13.375681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:13.375948 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:13.376220 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:13.390555 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:13.393217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:13.417671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:13.419126 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:13.420471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:13.420471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:13.420471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:13.424715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 414/824] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:13.432826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:13.603461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f629-8e0b-4ca3-999e-d4030e101780 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:13.659815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:13.673851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:13.674793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:13.675706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:13.676139 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:13.677266 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:13.677684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:13.680018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33ca4-58f0-4661-a9a2-68c58371e7d1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:13.698714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 411/825] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:13.707990 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:13.784905 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:13.851795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7e44-fd77-4a11-908e-57d6a663a95e None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:13.892556 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1167bf-d58b-4fa0-b8a0-dbcd68e7668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:13.893546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1167bf-d58b-4fa0-b8a0-dbcd68e7668f None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:13.894067 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1167bf-d58b-4fa0-b8a0-dbcd68e7668f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:13.894590 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1167bf-d58b-4fa0-b8a0-dbcd68e7668f None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:13.895517 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1167bf-d58b-4fa0-b8a0-dbcd68e7668f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:13.897225 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1167bf-d58b-4fa0-b8a0-dbcd68e7668f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:13.928414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 415/826] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 18 19:16:13 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:16:16.521360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98c05-6800-437f-b3e6-467acca87e5f None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:16.522103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98c05-6800-437f-b3e6-467acca87e5f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:16.522103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98c05-6800-437f-b3e6-467acca87e5f None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:16.523526 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 412/827] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:16.529634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:16.530135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:16.530243 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:16.555119 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:16.556341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:16.632651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 416/828] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:16:16.981616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98c05-6800-437f-b3e6-467acca87e5f None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:17.111746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98c05-6800-437f-b3e6-467acca87e5f None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:17.157331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:17.158015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:17.158298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:17.158574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:17.170977 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:16:17.176392 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:17.177577 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:17.178616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 413/829] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:17.183955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:17.231476 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:17.305023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe4fcc-bd5b-45b1-9d2a-366fe9c09ef4 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:17.340971 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:17.341684 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:17.341861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:17.342172 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:17.342844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] RBAC: Adding query filter params (name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:17.343151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:17.344758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:17.359182 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 417/830] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:16:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:17.365685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:17.424755 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:17.483522 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e049a-3ac6-4330-8683-1bfbfe8a81bf None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:17.526708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:17.527467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:17.527698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:17.528079 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:17.539762 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:17.541374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:17.558271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:17.564208 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:17.565597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:17.565597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:17.565597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:17.565597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 414/831] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:17.567659 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:17.680473 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:17.684074 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7b5b-9b38-439f-aebd-df1a33dd08eb None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:17.721761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:17.722929 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:17.723242 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:17.723489 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:17.724275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:17.724579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:17.725993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:17.740231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 418/832] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:17.746021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:17.866768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:17.870960 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52ab4-6547-4f0e-9e24-89326b25d330 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:17.911109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:17.911891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:17.912167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:17.912467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:17.921725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:17.923245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:16:17.936203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:17.937346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:17.938344 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 415/833] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:17.943789 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:18.056455 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821b17-0f90-4151-bacb-863606f29f12 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:18.090772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:18.091382 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:18.091651 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:18.091925 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:18.092750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:18.093021 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:18.094474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:18.119368 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 419/834] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 18 19:16:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:18.125508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:18.235570 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6355d5-a928-404a-8df3-44a745e7fa58 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:18.274372 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:18.274998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:18.275282 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:18.275559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:18.310421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:18.358520 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:18.360002 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:18.487181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 416/835] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:16:18 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:16:18.493064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:18.512633 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:18.614767 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536277-1588-4a90-9bc4-9bdbc73bb169 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:18.653453 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:18.654485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:18.654795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:18.655129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:18.666251 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:18.667790 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:18.683935 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:18.685017 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:18.685924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:18.685924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:18.685924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:18.685924 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 420/836] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:18.691735 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:18.758395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:18.804917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e2a8-7710-4ca7-8c76-cfdfd6ffbb35 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:18.846248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:18.846887 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:18.847169 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:18.847445 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:18.848094 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:18.848399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:18.849810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:18.863484 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 417/837] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:18.869358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:18.946003 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:18.986584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73454e-350f-4a0b-80a9-14d85f278f34 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:19.023000 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:19.023596 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:19.023876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:19.024155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:19.031721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:19.033404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:16:19.049522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:19.051366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:19.052494 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 421/838] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:19.059207 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:19.176151 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c521-66ea-463c-a01b-da0a0cc94df2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:19.199129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:19.229104 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:19.229770 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:19.230053 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:19.230326 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:19.231113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:19.231495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:19.233056 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703ca69-d852-48b9-a769-10488d1d3ac9 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:19.250902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 418/839] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:19.260050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:19.393681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2816aa-b61c-4f3b-a3b1-d68c4e91742c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:19.442396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:19.450327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:19.451074 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:19.451360 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:19.451744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:19.452702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=51ba6f3c73c64b9ba1b0ab1764a1509d) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:19.453128 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:19.454620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7119d1-d11a-48a1-88e3-179366fb9380 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:19.461994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 422/840] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:16:19 2022] GET /identity/v3/role_assignments?user.id=51ba6f3c73c64b9ba1b0ab1764a1509d&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:21.870856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c347bb-bec9-42ef-801a-7deda9259022 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:21.871789 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c347bb-bec9-42ef-801a-7deda9259022 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:21.871789 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c347bb-bec9-42ef-801a-7deda9259022 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:21.872757 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 419/841] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:21.879957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:21.880825 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:21.880825 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:21.901281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:21.902656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:21.984374 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 423/842] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:22.320406 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c347bb-bec9-42ef-801a-7deda9259022 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:22.457575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c347bb-bec9-42ef-801a-7deda9259022 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:22.515104 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:22.516069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:22.516568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:22.517013 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:22.537603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:16:22.546154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:22.548108 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:22.550017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 420/843] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:22.555958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:22.692016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ff7f0-c98e-4cdd-99c7-f242d294b1a3 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:22.742076 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:22.754444 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:22.755085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:22.755370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:22.755647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:22.756332 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] RBAC: Adding query filter params (name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:22.756650 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:22.758056 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:22.768102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 424/844] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:22.780604 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:22.830396 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:22.901802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7639e-dab4-4e24-8833-408103a73064 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:22.947275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:22.947918 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:22.948197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:22.948473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:22.964725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:22.968418 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:22.998202 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:23.000129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:23.008786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:23.008786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:23.008786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:23.008786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 421/845] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:23.009541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:23.164993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb97550-ca45-419f-9861-badbec08cf1c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:23.220911 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:23.221965 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:23.222441 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:23.222909 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:23.224007 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:23.224524 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:23.226920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:23.248842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 425/846] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:23.257251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:23.370680 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:23.385136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3763d-fe3f-4737-a690-070cc7522ce1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:23.446338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:23.446898 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:23.447183 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:23.447590 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:23.457423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:23.459014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:16:23.472461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:23.482892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:23.484722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 422/847] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:23.485541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:23.548920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:23.617566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b292-aaa8-4f76-a1aa-b2a8ab699dc3 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:23.655429 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:23.656082 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:23.656365 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:23.656645 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:23.657424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:23.657727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:23.659680 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:23.681859 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 426/848] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 18 19:16:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:23.687966 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:23.828293 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9db916-d040-4f0c-9be1-8d35e9a0700a None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:23.884594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:23.885569 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:23.885929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:23.886421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:23.905425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:23.906987 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:23.927963 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:23.930173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:23.932130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:23.932130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:23.932130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:23.932130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 423/849] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:23.936745 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:24.068655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574ae3-737d-4dc4-a6a1-b62562d2ce5b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:24.071695 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:24.115447 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:24.115865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:24.116145 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:24.116420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:24.117131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:24.117435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:24.119052 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:24.140520 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 427/850] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:24.147672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:24.151099 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:24.281168 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5dc8-cc2e-4563-a8c8-577882548ba3 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:24.342127 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:24.342905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:24.343189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:24.343491 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:24.350978 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:24.352513 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:16:24.368288 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:24.370415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:24.372324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 424/851] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:24.377113 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:24.507354 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a08b7-a78e-49fd-bc6f-8c5ca7652525 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:24.551887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:24.553050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:24.553534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:24.553907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:24.554923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:24.555438 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:24.557414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c053eb-3968-4519-8148-e3a350ceb580 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:24.574911 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 428/852] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:16:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:24.581904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:24.666401 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:24.717201 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ea8e4-7224-4177-8689-9e18792581c2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:24.759646 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ecc7f-fa7f-447a-ae40-d9b9e9016f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:24.760322 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ecc7f-fa7f-447a-ae40-d9b9e9016f26 None admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:24.760599 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ecc7f-fa7f-447a-ae40-d9b9e9016f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:24.760911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ecc7f-fa7f-447a-ae40-d9b9e9016f26 None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/51ba6f3c73c64b9ba1b0ab1764a1509d/roles/3664513bdfb64f3bb56a3c2c5769b1d1` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:24.782939 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ecc7f-fa7f-447a-ae40-d9b9e9016f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=51ba6f3c73c64b9ba1b0ab1764a1509d, role_id=3664513bdfb64f3bb56a3c2c5769b1d1)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:24.784414 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ecc7f-fa7f-447a-ae40-d9b9e9016f26 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:24.805480 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 425/853] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:16:24 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/51ba6f3c73c64b9ba1b0ab1764a1509d/roles/3664513bdfb64f3bb56a3c2c5769b1d1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:16:27.127483 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748ead-68c5-4af2-8ff2-a213e51e9d99 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:27.128200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748ead-68c5-4af2-8ff2-a213e51e9d99 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:27.128200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748ead-68c5-4af2-8ff2-a213e51e9d99 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:27.129788 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 429/854] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:27.137969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:27.138562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:27.138667 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:27.162974 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:27.164569 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:27.257868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 426/855] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:27.601255 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748ead-68c5-4af2-8ff2-a213e51e9d99 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:27.635214 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:27.733006 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748ead-68c5-4af2-8ff2-a213e51e9d99 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:27.779152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:27.780205 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:27.780666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:27.781370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:27.800196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:16:27.809538 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:27.811315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:16:27.813617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:27.816942 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 430/856] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 18 19:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:27.822153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:27.894947 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:27.989935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1197a4-d100-416c-a8b2-fa7583c6971b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:28.040568 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:28.041588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:28.042073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:28.042519 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:28.043802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:28.044373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:28.047507 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:28.069285 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 427/857] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 18 19:16:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:28.076101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:28.215883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:28.236357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cf402-4fa9-4b73-a43f-2b06fe65cef7 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:28.279466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:28.280132 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:28.280420 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:28.280724 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:28.292507 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:28.294015 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:28.311491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:28.313058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:28.314922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:28.314922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:28.314922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:28.314922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 431/858] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:28.321767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:28.458018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e69eb-86ac-43bd-9fe1-4de6600531c1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:28.461615 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:28.502686 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:28.503732 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:28.504014 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:28.504298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:28.505004 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:28.505311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:28.506696 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:28.525593 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 428/859] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:28.529907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:28.665662 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4563e-a96a-4137-9e95-67a82680924a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:28.725190 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:28.725835 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:28.726115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:28.726562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:28.730625 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:28.738142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:28.740750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:16:28.753698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:28.755060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:28.757155 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 432/860] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:28.761650 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:28.901180 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e0e3-c517-434e-ae81-ffdafd0f57e2 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:28.939405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:28.940408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:28.940725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:28.941105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:28.942101 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:28.942447 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:28.944318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:28.976178 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 429/861] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 18 19:16:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:28.982480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:29.117969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b83ca-1e82-424f-b77d-2559ab06729f None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:29.166398 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:29.167016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:29.167300 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:29.167577 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:29.245352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:29.259410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:29.262183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:29.407344 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 433/862] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:16:28 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:16:29.416383 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:29.467928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:29.572940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37ee8-4c91-426c-9807-9acb224e37d3 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:29.621886 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:29.622512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:29.622924 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:29.623092 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:29.634636 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:29.636082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:29.651868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:29.657808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:29.659527 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:29.659527 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:29.659527 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:29.659527 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 430/863] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:29.659950 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:29.785863 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:29.793715 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400cc6c-203c-4cc2-b15b-7bf153d46c83 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:29.836054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:29.836792 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:29.837044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:29.837306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:29.837953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:29.838310 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:29.839696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:29.859036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 434/864] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:29.869030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:29.971420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:30.010164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875100-180f-4904-81ba-d3cc15553d28 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:30.051801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:30.052515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:30.052891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:30.053174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:30.062389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:30.064085 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:16:30.078172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:30.079164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:30.080157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 431/865] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:30.085336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:30.224251 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce65eb4-f771-4904-a4fc-ee7d1a7e4305 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:30.261671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:30.262358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:30.262567 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:30.262828 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:30.263537 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:30.263838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:30.265322 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeba3c-efa2-4b6d-a385-af98f8aec1e7 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:30.285998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 435/866] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:30.287314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:30.413299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf1d3-9bd6-4be3-9985-f330dad466d8 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:30.453337 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:30.454018 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:30.454304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:30.454492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:30.455369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] RBAC: Adding query filter params (role.id=3664513bdfb64f3bb56a3c2c5769b1d1, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=51ba6f3c73c64b9ba1b0ab1764a1509d) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:30.455685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:30.457847 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8f03a-bfba-490f-9f8e-f72e6399c17e None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:30.459953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:30.465871 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 432/867] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:16:30 2022] GET /identity/v3/role_assignments?user.id=51ba6f3c73c64b9ba1b0ab1764a1509d&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=3664513bdfb64f3bb56a3c2c5769b1d1 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:32.969796 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e3f15-34a9-41d0-b70e-0d5ae8972278 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:32.970410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e3f15-34a9-41d0-b70e-0d5ae8972278 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:32.970735 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e3f15-34a9-41d0-b70e-0d5ae8972278 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:32.973773 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 436/868] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:32.983119 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:32.983707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:32.984087 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:33.010054 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:33.012228 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:33.126746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 433/869] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:33.475703 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e3f15-34a9-41d0-b70e-0d5ae8972278 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:33.496593 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:33.615838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e3f15-34a9-41d0-b70e-0d5ae8972278 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:33.655911 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:33.656551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:33.656863 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:33.657137 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:33.671718 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:16:33.677839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:33.679080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:33.680111 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 437/870] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:33.687257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:33.824304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b591b-e9e0-4524-b8ef-bdae628fe668 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:33.856613 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:33.865841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:33.866458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:33.866764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:33.867043 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:33.867734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:33.868049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:33.871151 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:33.879127 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 434/871] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:33.885068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:33.984217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:34.022424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a9cb1-4505-49b5-99a8-e4ab95bf7356 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:34.084880 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:34.085929 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:34.086406 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:34.086885 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:34.103634 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:34.106011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:34.125996 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:34.127221 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:34.129223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:34.129223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:34.129223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:34.129223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 438/872] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:34.143698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:34.280487 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe7b5b-aab3-447e-b513-76fe98e84ef1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:34.320251 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:34.320981 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:34.321292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:34.321472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:34.322157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:34.322462 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:34.323990 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:34.338733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 435/873] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:34.344999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:34.485629 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09c3a-9f32-4241-9607-945b7c2f5069 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:34.522603 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:34.533390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:34.534735 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:34.535173 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:34.535509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:34.546085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:34.548046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:16:34.564456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:34.566580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:34.568417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 439/874] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:34.574104 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:34.650227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:34.718334 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766ec2-3c1f-4342-b76c-5f40ab0fd079 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:34.767158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:34.767766 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:34.768050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:34.768355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:34.769123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:34.769433 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:34.770865 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:34.791461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 436/875] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 18 19:16:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:34.797440 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:34.921708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9685b3-57b2-4763-a776-291514e3c8ce None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:34.966044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:34.966684 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:34.966986 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:34.967226 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:35.036436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:35.055861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:35.057482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:35.191776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 440/876] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:16:34 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 19:16:35.197838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:35.316842 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56985b-df83-4331-be57-a4b25cd79f4b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:35.331189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:35.364144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:35.365341 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:35.365799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:35.366258 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:35.380080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:35.381700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:35.399591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:35.400862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:35.401953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:35.401953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:35.401953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:35.401953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 437/877] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:35.408016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:35.522189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:35.544655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84525daa-040c-4824-8ae0-ad45f62d32b4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:35.590666 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:35.591342 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:35.591770 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:35.592033 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:35.592846 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:35.593216 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:35.594653 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:35.608621 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 441/878] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:35.614882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:35.747395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277936c-5bd3-4bea-a916-a161383b245b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:35.792762 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:35.793470 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:35.793766 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:35.794090 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:35.803353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:35.804881 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:16:35.818767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:35.820823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:35.822588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 438/879] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:35.828428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:35.981157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fcc73-2271-44ab-b7cb-eef484c7640c None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:36.020970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:36.021611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:36.021908 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:36.022166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:36.022899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:36.023209 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:36.024849 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6233d-f86c-46df-a55e-761c362c119e None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:36.047952 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 442/880] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:36.055160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:36.082607 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:36.188834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5dfb5-247b-48db-968e-8addead04fb1 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:36.227219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:36.227871 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:36.228378 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:36.228659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:36.229412 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=51ba6f3c73c64b9ba1b0ab1764a1509d) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:36.229730 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:36.231157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd14f3-f1b7-421b-b3e2-1093f752cac0 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:36.238215 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 439/881] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:16:36 2022] GET /identity/v3/role_assignments?user.id=51ba6f3c73c64b9ba1b0ab1764a1509d&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:38.449071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ce56-1d42-423d-b9c7-b67e2cf28582 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:38.449657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ce56-1d42-423d-b9c7-b67e2cf28582 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:38.449657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ce56-1d42-423d-b9c7-b67e2cf28582 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:38.450975 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 443/882] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:38.457432 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:38.458021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:38.458021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:38.477641 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:38.479115 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:38.554252 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 440/883] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:38.883783 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ce56-1d42-423d-b9c7-b67e2cf28582 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:38.895235 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:38.993931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ce56-1d42-423d-b9c7-b67e2cf28582 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:39.029355 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:39.030063 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:39.030501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:39.030928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:39.042380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:16:39.047085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:39.048275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:39.049341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 444/884] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:39.056989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:39.072453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:39.177675 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d296dfa-a051-4f66-ab13-317369475b44 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:39.216114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:39.216955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:39.217163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:39.217338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:39.218028 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:39.218335 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:39.219726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:39.231256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 441/885] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:39.238580 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:39.324083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:39.372189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13561ab7-734d-4891-ac84-b3275713667b None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:39.407700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:39.408338 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:39.408619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:39.408964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:39.420183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:39.421689 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:39.437231 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:39.438366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:39.439401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:39.439401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:39.439401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:39.439401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 445/886] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:39.445257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:39.529542 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:39.554082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa1fdd-b290-4552-8a2a-ab7961267142 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:39.593292 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:39.594113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:39.594545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:39.594834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:39.595829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:39.596230 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:39.598371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:39.611149 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 442/887] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:39.617219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:39.770845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0160a7-1b59-4249-9edf-86c3de47dff0 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:39.792375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:39.809546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:39.810189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:39.810474 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:39.810750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:39.820931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:39.822409 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:16:39.835050 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:39.836246 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:39.837468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 446/888] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:39.842992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:39.949065 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807fa5d-cd84-440f-8a5b-75f62e9023ec None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:39.986207 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:39.986810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:39.987210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:39.987556 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:39.988736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:39.989166 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:39.991155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:39.994515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:40.010416 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 443/889] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 18 19:16:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:40.016359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:40.130779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab832e-9b38-4998-b5ec-eca3b4229650 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:40.165800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:40.166427 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:40.166708 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:40.166980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:40.177928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:40.179390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:40.194071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:40.195396 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:40.196667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:40.196667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:40.196667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:40.196667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 447/890] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:40.205534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:40.319321 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad51a5-d080-4887-bc23-712c3a8c3581 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:40.357471 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:40.358107 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:40.358389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:40.358665 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:40.359429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:40.359785 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:40.361232 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:40.373244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 444/891] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:40.379193 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:40.412559 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:40.483085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcada8b-0f09-44e8-af45-4d3218cd182a None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:40.516883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:40.517518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:40.517799 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:40.518077 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:40.527587 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:40.529141 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:16:40.541071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:40.542400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:40.543677 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 448/892] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:40.549562 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:40.610872 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:40.661490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef27a88-c162-49cf-9cfa-55dbefbbf022 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:40.696836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:40.697663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:40.698009 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:40.698286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:40.699421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:40.699752 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:40.701204 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea655652-667d-4914-8b08-fdf3b5c1958c None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:40.714369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 445/893] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:40.720404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:40.817725 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:40.827092 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c1df4-5125-41f5-b108-2fed98375279 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:40.861390 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4fce-a445-4104-80b6-743f957520d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:40.862565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4fce-a445-4104-80b6-743f957520d2 None admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:40.862842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4fce-a445-4104-80b6-743f957520d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:40.863115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4fce-a445-4104-80b6-743f957520d2 None admin] PATH_INFO: `/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/51ba6f3c73c64b9ba1b0ab1764a1509d/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:40.865498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4fce-a445-4104-80b6-743f957520d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c89dd242bc6e48e5a0a73850a2fe5d6f, user_id=51ba6f3c73c64b9ba1b0ab1764a1509d, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:40.866526 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4fce-a445-4104-80b6-743f957520d2 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:40.879903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 449/894] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 18 19:16:40 2022] PUT /identity/v3/projects/c89dd242bc6e48e5a0a73850a2fe5d6f/users/51ba6f3c73c64b9ba1b0ab1764a1509d/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:16:43.047679 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db360c0-3674-4de3-ad0b-e953df326c7e None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:43.048192 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db360c0-3674-4de3-ad0b-e953df326c7e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:43.048192 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db360c0-3674-4de3-ad0b-e953df326c7e None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:43.050030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 446/895] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:43.055096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:43.055515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:43.055656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:43.073301 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:43.074478 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:43.148415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 450/896] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:43.483978 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db360c0-3674-4de3-ad0b-e953df326c7e None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:43.590823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db360c0-3674-4de3-ad0b-e953df326c7e None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:43.605883 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:43.626984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:43.628126 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:43.628406 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:43.628701 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:43.638972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:16:43.644221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:43.645429 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:43.646428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 447/897] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 18 19:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:43.652821 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:43.734512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:43.754748 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93578301-bfe1-4a2e-ae9f-52a65fedb7e9 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:43.788670 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:43.789309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:43.789588 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:43.789858 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:43.790523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:43.790827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:43.792188 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:43.800920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 451/898] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 18 19:16:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:43.806718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:43.908734 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236bfd-961b-4115-adce-01aaf7162167 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:43.942316 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:43.942941 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:43.943247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:43.943516 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:43.953300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:43.954727 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:43.969243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:43.970366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:43.972173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:43.972173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:43.972173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:43.972173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 448/899] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:43.976617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:44.072529 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d18f0-57ae-4133-b3ec-e65c94c645e8 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:44.107048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:44.107653 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:44.107931 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:44.108201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:44.108868 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:44.109170 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:44.110516 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:44.121973 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 452/900] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:44.127708 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:44.155386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:44.229135 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7336456-068c-485a-bdde-222df7f6bba5 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:44.265155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:44.265778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:44.266060 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:44.266337 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:44.274332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:44.275763 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:16:44.286722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:44.287932 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:44.288910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 449/901] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:16:44.293585 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:44.297404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:44.395290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f6e0-42d1-430d-94c9-322da8f16794 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:44.429603 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:44.430222 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:44.430506 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:44.430779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:44.431511 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:44.431818 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:44.433302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:44.452226 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 453/902] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 18 19:16:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:44.458801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:44.548390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:44.563655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce8b39-019f-4253-9310-8fa7949c9c2b None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:44.599625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:44.600233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:44.600512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:44.600808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:44.671225 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:44.672670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:44.757841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:44.775181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 450/903] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 18 19:16:44 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:16:44.781175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:44.845561 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:44.887998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa77e8-f849-45c8-bfbb-bbcd2d9b51f4 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:44.922361 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:44.922903 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:44.923183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:44.923458 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:44.934563 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:44.936023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:16:44.951036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:44.952197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:16:44.953116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:16:44.953116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:16:44.953116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:44.953116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 454/904] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:44.958244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:45.060422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c659-e8c0-412a-ab58-6143b623e76f None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:45.092881 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:45.093482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:45.093756 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:45.094028 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:45.094659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:45.094953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:45.096902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:45.110226 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 451/905] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 18 19:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:45.116395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:45.214103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc954fe-2374-4ca1-929b-4bf4530b8476 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:45.227459 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:45.247535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:45.248152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:45.248428 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:45.248716 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:45.255031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:45.256444 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:16:45.267086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:45.268115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: ERROR keystone.server.flask.application Aug 18 19:16:45.269201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 455/906] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 18 19:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:45.274181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:45.319773 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:45.378718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7254876-3e36-488a-92c0-7c8b2e29a472 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:45.413749 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:45.414365 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:45.414643 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:45.414917 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:45.415612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:45.415916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:45.417356 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729a5b8-90e7-45f4-9614-c6c804727df6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:45.429497 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 452/907] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 18 19:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:16:45.435808 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:45.537827 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2df485-2d0f-4946-8f90-141a7e8d6776 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:45.576170 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:45.576873 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:45.577159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:45.577434 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:45.578192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] RBAC: Adding query filter params (role.id=c016aacdd65d4e0287a9d1177e7a0e5c, scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f, user.id=51ba6f3c73c64b9ba1b0ab1764a1509d) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:45.578500 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:45.579958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709c1aa-5639-4577-8b93-ed29fc24c87d None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:45.586823 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 456/908] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 18 19:16:45 2022] GET /identity/v3/role_assignments?user.id=51ba6f3c73c64b9ba1b0ab1764a1509d&scope.project.id=c89dd242bc6e48e5a0a73850a2fe5d6f&role.id=c016aacdd65d4e0287a9d1177e7a0e5c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:47.825026 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c651b24-2843-4872-9c5f-8296555a6803 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:47.825598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c651b24-2843-4872-9c5f-8296555a6803 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:47.825598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c651b24-2843-4872-9c5f-8296555a6803 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:47.826886 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 453/909] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:47.832707 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:47.833192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:47.833309 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:47.851980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:47.853414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:47.884359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:47.921362 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 457/910] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:48.262851 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c651b24-2843-4872-9c5f-8296555a6803 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:48.362841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c651b24-2843-4872-9c5f-8296555a6803 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:48.370552 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:48.401138 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:48.401767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:48.402051 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:48.402327 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:48.402910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:48.404263 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:48.413625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:48.414862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:48.415943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:48.419704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 454/911] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 18 19:16:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:48.420934 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:48.524541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf407c-971c-486a-a1e6-8a1cb51e04d4 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:48.560175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:48.560833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:48.561121 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:48.561399 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:48.562040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:48.562341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:48.563722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe201e39-b211-4ef1-ae65-2d0d03ef56b0 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:48.568751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 458/912] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 18 19:16:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:48.575597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:48.680271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cad02-b937-46c2-84a9-c7430945f777 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:48.714235 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:48.714849 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:48.715128 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:48.715402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] PATH_INFO: `/v3/services` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:48.716043 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:48.716349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:48.717758 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d536187-e27a-4daf-87f4-acaa94bd88f4 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:48.723830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 455/913] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 18 19:16:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:50.927095 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1e28-888d-4399-b779-9b0d86a55492 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:50.927609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1e28-888d-4399-b779-9b0d86a55492 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:50.927609 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1e28-888d-4399-b779-9b0d86a55492 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:50.928879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 459/914] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:50.933910 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac27ba-5c72-4a9a-a264-0522cc55b034 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:50.934338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac27ba-5c72-4a9a-a264-0522cc55b034 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:50.934457 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac27ba-5c72-4a9a-a264-0522cc55b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:50.952849 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-00ac27ba-5c72-4a9a-a264-0522cc55b034 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:50.954043 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-00ac27ba-5c72-4a9a-a264-0522cc55b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:50.979849 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:51.019949 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 456/915] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:51.382412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b1e28-888d-4399-b779-9b0d86a55492 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:51.414531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:51.487122 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b1e28-888d-4399-b779-9b0d86a55492 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:51.521253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af29c0-2a2e-4460-9776-85d85c0cf5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:51.521866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af29c0-2a2e-4460-9776-85d85c0cf5da None admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:51.522150 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af29c0-2a2e-4460-9776-85d85c0cf5da None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:51.522426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af29c0-2a2e-4460-9776-85d85c0cf5da None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:51.523072 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af29c0-2a2e-4460-9776-85d85c0cf5da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:51.524445 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af29c0-2a2e-4460-9776-85d85c0cf5da None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:51.539945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 460/916] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 18 19:16:51 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:16:53.789281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e713ba-71b8-49d2-8aa2-ebbf8dd3e85f None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:53.789832 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e713ba-71b8-49d2-8aa2-ebbf8dd3e85f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:53.789832 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e713ba-71b8-49d2-8aa2-ebbf8dd3e85f None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:53.791198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 457/917] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:53.797083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:53.797606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:53.797699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:53.815650 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:53.816883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:53.896570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 461/918] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:53 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:16:54.246287 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e713ba-71b8-49d2-8aa2-ebbf8dd3e85f None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:54.352940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e713ba-71b8-49d2-8aa2-ebbf8dd3e85f None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:54.395499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:54.396134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:54.396413 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:54.396718 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:54.397298 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:54.398654 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:54.407525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:54.409380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:54.410458 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 458/919] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 18 19:16:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:54.415545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:54.435140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:54.517696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102de9c-82d2-43f0-9fe4-32fc41d8c368 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:54.561527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:54.562135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:54.562426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:54.562703 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:54.563338 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:54.563644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:54.565072 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:54.570323 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 462/920] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 18 19:16:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:54.576957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:54.606698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:54.677329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b707b-d6cf-4b6c-a7ac-e826c95eb02d None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:54.710390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:54.710990 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:54.711274 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:54.711695 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:54.712397 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] RBAC: Adding query filter params (interface=public, service_id=91f6344862e54c6e9661b3c568de63f0, region_id=RegionOne) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:54.712732 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:54.714082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bc70a-d805-40a6-a557-d816b0aecf7b None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:54.718940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 459/921] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 18 19:16:54 2022] GET /identity/v3/endpoints?service_id=91f6344862e54c6e9661b3c568de63f0&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:54.725518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:54.808484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:54.826921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d1dc3-d0a1-4d60-ac5d-6f8b3f7d9933 None admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:54.861179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b994385-6cf3-4631-a950-5881cd9a6d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:54.861785 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994385-6cf3-4631-a950-5881cd9a6d86 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:54.862064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994385-6cf3-4631-a950-5881cd9a6d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:54.862338 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994385-6cf3-4631-a950-5881cd9a6d86 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:54.862936 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b994385-6cf3-4631-a950-5881cd9a6d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:54.864294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b994385-6cf3-4631-a950-5881cd9a6d86 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:54.870582 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 463/922] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 18 19:16:54 2022] GET /identity/v3/services => generated 1962 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:16:57.070046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ecb24-a3a6-44c8-a745-8e60dba7c42b None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:57.070624 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ecb24-a3a6-44c8-a745-8e60dba7c42b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:57.070624 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ecb24-a3a6-44c8-a745-8e60dba7c42b None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:57.071915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 460/923] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:16:57.077193 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:57.077594 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:57.077998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:57.096217 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:16:57.097424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:16:57.162893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 464/924] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:16:57 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:16:57.489519 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ecb24-a3a6-44c8-a745-8e60dba7c42b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:57.580612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:57.590682 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ecb24-a3a6-44c8-a745-8e60dba7c42b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:57.624508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:57.625158 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:57.625437 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:57.625711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:57.626291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:57.628250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:16:57.636700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:16:57.637935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application with Lock( Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: ERROR keystone.server.flask.application Aug 18 19:16:57.638840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 461/925] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 18 19:16:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:16:57.643824 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:57.717092 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:16:57.740482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4782b-79cd-4dff-a32f-529f585a0f26 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:57.776391 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:57.777036 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:57.777317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:57.777588 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] PATH_INFO: `/v3/services` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:57.778229 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:16:57.778528 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:57.779907 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dea295-c343-4be7-a3f8-08d17668f021 None admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:57.786242 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 465/926] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 18 19:16:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:16:57.791893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:16:57.892500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ff5c-a39e-4b3b-a674-b29390001ed6 None admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:16:57.925639 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa8d0a-f7f2-493a-bcff-905a65056757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:16:57.926203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8d0a-f7f2-493a-bcff-905a65056757 None admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:16:57.926481 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8d0a-f7f2-493a-bcff-905a65056757 None admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:16:57.926755 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8d0a-f7f2-493a-bcff-905a65056757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:16:57.927409 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa8d0a-f7f2-493a-bcff-905a65056757 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:16:57.928778 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa8d0a-f7f2-493a-bcff-905a65056757 None admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:16:57.948144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 462/927] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:16:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:17:07.782318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=30 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:17:07.943969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:17:58.920916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c4d8-4d0d-4b05-ba56-97b6108cf434 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:17:58.920916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c4d8-4d0d-4b05-ba56-97b6108cf434 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:17:58.920916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c4d8-4d0d-4b05-ba56-97b6108cf434 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:17:58.927274 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbceb4-64d8-4e99-9a54-648b1014cca1 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:17:58.927775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbceb4-64d8-4e99-9a54-648b1014cca1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:17:58.927855 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbceb4-64d8-4e99-9a54-648b1014cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:17:58.930861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 466/928] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:17:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:17:58.957052 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-97bbceb4-64d8-4e99-9a54-648b1014cca1 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:17:58.958549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-97bbceb4-64d8-4e99-9a54-648b1014cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:17:59.078715 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 463/929] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:17:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:17:59.432920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d269d3-ba61-47d4-a64f-8b8f18404c3e None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:17:59.433293 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d269d3-ba61-47d4-a64f-8b8f18404c3e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:17:59.433471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d269d3-ba61-47d4-a64f-8b8f18404c3e None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:17:59.434952 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 467/930] 10.222.0.46 () {54 vars in 965 bytes} [Thu Aug 18 19:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:17:59.441631 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe461c-bc98-4c4c-a372-1ecba8ae3e3d None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:17:59.442036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe461c-bc98-4c4c-a372-1ecba8ae3e3d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:17:59.442428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe461c-bc98-4c4c-a372-1ecba8ae3e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:17:59.512754 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-49fe461c-bc98-4c4c-a372-1ecba8ae3e3d None None] MFA Rules not processed for user `d18820ebfa644e8585f64355e8bf0f71`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:17:59.514356 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-49fe461c-bc98-4c4c-a372-1ecba8ae3e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:17:59.582992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 464/931] 10.222.0.46 () {58 vars in 1062 bytes} [Thu Aug 18 19:17:59 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:17:59.592898 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d269d3-ba61-47d4-a64f-8b8f18404c3e None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:17:59.605587 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d269d3-ba61-47d4-a64f-8b8f18404c3e None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:17:59.609441 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea2a94-7990-4fa4-bdca-759fb676fd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:17:59.610426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea2a94-7990-4fa4-bdca-759fb676fd55 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:17:59.610426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea2a94-7990-4fa4-bdca-759fb676fd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:17:59.610786 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea2a94-7990-4fa4-bdca-759fb676fd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:17:59.622002 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea2a94-7990-4fa4-bdca-759fb676fd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:17:59.623530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea2a94-7990-4fa4-bdca-759fb676fd55 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:17:59.638727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 468/932] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:17:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:02.143153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c59e-d56b-4a8e-882c-235af900d30c None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:02.144326 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c59e-d56b-4a8e-882c-235af900d30c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:02.144326 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c59e-d56b-4a8e-882c-235af900d30c None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:02.145123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 465/933] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:02.150541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40f49b-3890-4dac-bc20-4cbead8e1d23 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:02.150979 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40f49b-3890-4dac-bc20-4cbead8e1d23 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:02.151101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40f49b-3890-4dac-bc20-4cbead8e1d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:02.170905 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-0c40f49b-3890-4dac-bc20-4cbead8e1d23 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:02.172087 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-0c40f49b-3890-4dac-bc20-4cbead8e1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:02.180518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 469/934] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:02.538017 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb007-4823-4c2f-b115-1476ef915d6d None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:02.538312 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb007-4823-4c2f-b115-1476ef915d6d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:02.538765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb007-4823-4c2f-b115-1476ef915d6d None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:02.540374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 466/935] 10.222.0.46 () {54 vars in 965 bytes} [Thu Aug 18 19:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:02.547011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044679-0fb3-43b1-9c57-06927871c858 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:02.547357 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044679-0fb3-43b1-9c57-06927871c858 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:02.547588 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044679-0fb3-43b1-9c57-06927871c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:02.569107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-99044679-0fb3-43b1-9c57-06927871c858 None None] MFA Rules not processed for user `d18820ebfa644e8585f64355e8bf0f71`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:02.570426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-99044679-0fb3-43b1-9c57-06927871c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:02.577243 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 470/936] 10.222.0.46 () {58 vars in 1062 bytes} [Thu Aug 18 19:18:02 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:02.586663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deb007-4823-4c2f-b115-1476ef915d6d None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:02.598539 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deb007-4823-4c2f-b115-1476ef915d6d None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:02.602199 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060b55c-b5ed-4d2a-8e68-d5e6a5ff87ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:02.602828 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060b55c-b5ed-4d2a-8e68-d5e6a5ff87ce service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:02.603114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060b55c-b5ed-4d2a-8e68-d5e6a5ff87ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:02.603394 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060b55c-b5ed-4d2a-8e68-d5e6a5ff87ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:02.615112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060b55c-b5ed-4d2a-8e68-d5e6a5ff87ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:02.616616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060b55c-b5ed-4d2a-8e68-d5e6a5ff87ce service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:02.627768 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 467/937] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:05.360660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd934-175a-4fef-9ccb-ff2e39019d39 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:05.361775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd934-175a-4fef-9ccb-ff2e39019d39 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:05.361775 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd934-175a-4fef-9ccb-ff2e39019d39 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:05.363080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 471/938] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:05.368410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6c7a-955f-4a06-b079-75846a64874b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:05.368883 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6c7a-955f-4a06-b079-75846a64874b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:05.368998 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6c7a-955f-4a06-b079-75846a64874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:05.409165 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-8e9b6c7a-955f-4a06-b079-75846a64874b None None] MFA Rules not processed for user `13d25a9769a34aecaaeb423decbf57f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:05.410379 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-8e9b6c7a-955f-4a06-b079-75846a64874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:05.452574 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:18:05.479950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 468/939] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:05 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:05.829655 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fd934-175a-4fef-9ccb-ff2e39019d39 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:05.840888 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fd934-175a-4fef-9ccb-ff2e39019d39 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:05.844414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce919c-bd1d-4695-aec6-1134467e27c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:05.845051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce919c-bd1d-4695-aec6-1134467e27c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:05.845862 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce919c-bd1d-4695-aec6-1134467e27c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:05.846116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce919c-bd1d-4695-aec6-1134467e27c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:05.855380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce919c-bd1d-4695-aec6-1134467e27c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:05.856849 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce919c-bd1d-4695-aec6-1134467e27c9 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:05.866932 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 472/940] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:05 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:08.679651 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c93f-d7e9-43d4-9ddc-abc7e2a20d12 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:08.680193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c93f-d7e9-43d4-9ddc-abc7e2a20d12 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:08.680193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c93f-d7e9-43d4-9ddc-abc7e2a20d12 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:08.681550 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 469/941] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:08.686876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83977f40-f004-4e14-ac21-58235cb4debb None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:08.687295 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83977f40-f004-4e14-ac21-58235cb4debb None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:08.687427 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83977f40-f004-4e14-ac21-58235cb4debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:08.707529 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-83977f40-f004-4e14-ac21-58235cb4debb None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:08.708767 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-83977f40-f004-4e14-ac21-58235cb4debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:08.779370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 473/942] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:08 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:09.121148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c93f-d7e9-43d4-9ddc-abc7e2a20d12 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:09.132211 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c93f-d7e9-43d4-9ddc-abc7e2a20d12 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:09.135648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514330c-cbc8-480f-a1f3-96d2f84d80dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:09.136241 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514330c-cbc8-480f-a1f3-96d2f84d80dc service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:09.136525 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514330c-cbc8-480f-a1f3-96d2f84d80dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:09.136843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514330c-cbc8-480f-a1f3-96d2f84d80dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:09.145550 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514330c-cbc8-480f-a1f3-96d2f84d80dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:09.146965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514330c-cbc8-480f-a1f3-96d2f84d80dc service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:09.156273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 470/943] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:09 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:12.248219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80bbb9-93b2-4e1d-8709-265294ee21a6 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:12.248784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80bbb9-93b2-4e1d-8709-265294ee21a6 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:12.248900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80bbb9-93b2-4e1d-8709-265294ee21a6 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:12.250152 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 474/944] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:12.255638 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc289d-a84e-4428-8da6-2199ec34e7ba None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:12.256133 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc289d-a84e-4428-8da6-2199ec34e7ba None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:12.256332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc289d-a84e-4428-8da6-2199ec34e7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:12.276163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-0dcc289d-a84e-4428-8da6-2199ec34e7ba None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:12.277425 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-0dcc289d-a84e-4428-8da6-2199ec34e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:12.285808 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 471/945] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:12.620871 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80bbb9-93b2-4e1d-8709-265294ee21a6 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:12.632058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80bbb9-93b2-4e1d-8709-265294ee21a6 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:12.635534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1d4e8-ef68-4249-9256-f59491bf7118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:12.636132 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1d4e8-ef68-4249-9256-f59491bf7118 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:12.636412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1d4e8-ef68-4249-9256-f59491bf7118 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:12.636701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1d4e8-ef68-4249-9256-f59491bf7118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:12.646807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1d4e8-ef68-4249-9256-f59491bf7118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:12.648243 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1d4e8-ef68-4249-9256-f59491bf7118 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:12.657804 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 475/946] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:14.914648 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b782fc-29a4-4a1e-8623-fd85263b5afb None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:14.915187 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b782fc-29a4-4a1e-8623-fd85263b5afb None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:14.915187 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b782fc-29a4-4a1e-8623-fd85263b5afb None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:14.916504 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 472/947] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:14.921760 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886453b-792f-4850-a971-c5afa8d58eec None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:14.922223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886453b-792f-4850-a971-c5afa8d58eec None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:14.922315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886453b-792f-4850-a971-c5afa8d58eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:14.941743 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-a886453b-792f-4850-a971-c5afa8d58eec None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:14.942927 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-a886453b-792f-4850-a971-c5afa8d58eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:14.950572 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 476/948] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:15.292050 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b782fc-29a4-4a1e-8623-fd85263b5afb None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:15.302510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b782fc-29a4-4a1e-8623-fd85263b5afb None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:15.306036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc3bb-8829-48fa-955e-970ba22de9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:15.306629 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc3bb-8829-48fa-955e-970ba22de9ce service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:15.306911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc3bb-8829-48fa-955e-970ba22de9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:15.307261 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc3bb-8829-48fa-955e-970ba22de9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:15.316320 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc3bb-8829-48fa-955e-970ba22de9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:15.317773 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc3bb-8829-48fa-955e-970ba22de9ce service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:15.327988 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 473/949] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:17.558662 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2968-c0cb-45eb-9253-6776d3283dfb None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:17.559196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2968-c0cb-45eb-9253-6776d3283dfb None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:17.559196 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2968-c0cb-45eb-9253-6776d3283dfb None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:17.560534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 477/950] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:17.566646 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676497-356b-4909-b673-7a1cbf8dabd5 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:17.567076 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676497-356b-4909-b673-7a1cbf8dabd5 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:17.567187 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676497-356b-4909-b673-7a1cbf8dabd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:17.585959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-9e676497-356b-4909-b673-7a1cbf8dabd5 None None] MFA Rules not processed for user `13d25a9769a34aecaaeb423decbf57f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:17.587276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-9e676497-356b-4909-b673-7a1cbf8dabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:17.596153 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 474/951] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:17 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:17.935864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2968-c0cb-45eb-9253-6776d3283dfb None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:17.946377 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2968-c0cb-45eb-9253-6776d3283dfb None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:17.949765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245fb96-9ae6-4648-82a4-fb49a88bf7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:17.950351 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fb96-9ae6-4648-82a4-fb49a88bf7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:17.950627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fb96-9ae6-4648-82a4-fb49a88bf7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:17.950898 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fb96-9ae6-4648-82a4-fb49a88bf7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:17.959739 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245fb96-9ae6-4648-82a4-fb49a88bf7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:17.961201 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245fb96-9ae6-4648-82a4-fb49a88bf7d4 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:17.970957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 478/952] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:17 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:20.405144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bc60-eda5-40cd-8a78-1867167c40d7 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:20.405672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bc60-eda5-40cd-8a78-1867167c40d7 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:20.405672 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bc60-eda5-40cd-8a78-1867167c40d7 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:20.407057 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 475/953] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:20.413025 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694601-84f9-411f-b4e2-c83541a45d44 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:20.413556 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694601-84f9-411f-b4e2-c83541a45d44 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:20.413556 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694601-84f9-411f-b4e2-c83541a45d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:20.433414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-95694601-84f9-411f-b4e2-c83541a45d44 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:20.434597 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-95694601-84f9-411f-b4e2-c83541a45d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:20.443085 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 479/954] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:20.780836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bc60-eda5-40cd-8a78-1867167c40d7 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:20.791911 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bc60-eda5-40cd-8a78-1867167c40d7 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:20.795397 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f6cb3-bdb5-4f2f-ae2e-392026f79d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:20.795993 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6cb3-bdb5-4f2f-ae2e-392026f79d63 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:20.796271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6cb3-bdb5-4f2f-ae2e-392026f79d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:20.796538 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6cb3-bdb5-4f2f-ae2e-392026f79d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:20.806466 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6cb3-bdb5-4f2f-ae2e-392026f79d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:20.807876 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6cb3-bdb5-4f2f-ae2e-392026f79d63 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:20.817246 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 476/955] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:23.047272 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30c5e5-7917-4e99-8a56-9576e7422671 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:23.047786 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30c5e5-7917-4e99-8a56-9576e7422671 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:23.047786 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30c5e5-7917-4e99-8a56-9576e7422671 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:23.049131 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 480/956] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:23.054219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065670d-d294-47c3-9297-427f630a55b3 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:23.054642 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065670d-d294-47c3-9297-427f630a55b3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:23.054786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065670d-d294-47c3-9297-427f630a55b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:23.075788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-0065670d-d294-47c3-9297-427f630a55b3 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:23.077009 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-0065670d-d294-47c3-9297-427f630a55b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:23.085432 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 477/957] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:18:23.429409 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30c5e5-7917-4e99-8a56-9576e7422671 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:23.443791 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30c5e5-7917-4e99-8a56-9576e7422671 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:23.447410 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef524d-0334-40ff-876d-5b86a2bc20ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:23.448013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef524d-0334-40ff-876d-5b86a2bc20ec service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:23.448294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef524d-0334-40ff-876d-5b86a2bc20ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:23.448564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef524d-0334-40ff-876d-5b86a2bc20ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:23.458470 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef524d-0334-40ff-876d-5b86a2bc20ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:23.459888 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef524d-0334-40ff-876d-5b86a2bc20ec service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:23.469626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 481/958] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:26.037713 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a7e8-e307-49a4-a3bf-881c78df0fd3 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:26.038229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a7e8-e307-49a4-a3bf-881c78df0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:26.038229 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a7e8-e307-49a4-a3bf-881c78df0fd3 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:26.039490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 478/959] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:26.044592 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f6cad-a146-4c02-b8a0-2087636b2b2e None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:26.045068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f6cad-a146-4c02-b8a0-2087636b2b2e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:26.045163 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f6cad-a146-4c02-b8a0-2087636b2b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:26.064279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-680f6cad-a146-4c02-b8a0-2087636b2b2e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:26.065485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-680f6cad-a146-4c02-b8a0-2087636b2b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:26.073088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 482/960] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:26 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:26.408617 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5a7e8-e307-49a4-a3bf-881c78df0fd3 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:26.419112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5a7e8-e307-49a4-a3bf-881c78df0fd3 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:26.422493 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2ae4-84b3-4de6-a615-6b9c442622ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:26.423589 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2ae4-84b3-4de6-a615-6b9c442622ed service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:26.423865 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2ae4-84b3-4de6-a615-6b9c442622ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:26.424136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2ae4-84b3-4de6-a615-6b9c442622ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:26.432671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b2ae4-84b3-4de6-a615-6b9c442622ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:26.434109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b2ae4-84b3-4de6-a615-6b9c442622ed service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:26.443916 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 479/961] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:26 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:30.618463 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9f69-8d38-4a5c-a018-2f1d5dbd6ad4 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:30.619037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9f69-8d38-4a5c-a018-2f1d5dbd6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:30.619037 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9f69-8d38-4a5c-a018-2f1d5dbd6ad4 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:30.620369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 483/962] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:18:30.625600 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a889c-b014-4556-ba26-c01ecf38032a None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:30.626569 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a889c-b014-4556-ba26-c01ecf38032a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:30.626819 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a889c-b014-4556-ba26-c01ecf38032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:30.647193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-095a889c-b014-4556-ba26-c01ecf38032a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:30.648422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-095a889c-b014-4556-ba26-c01ecf38032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:30.656615 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 480/963] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:30.998522 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9f69-8d38-4a5c-a018-2f1d5dbd6ad4 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:31.004491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=77 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:18:31.011001 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9f69-8d38-4a5c-a018-2f1d5dbd6ad4 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:31.014520 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a80d3-e9b9-4f1f-9c8c-fe0433c87ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:31.015180 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a80d3-e9b9-4f1f-9c8c-fe0433c87ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:31.015461 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a80d3-e9b9-4f1f-9c8c-fe0433c87ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:31.015731 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a80d3-e9b9-4f1f-9c8c-fe0433c87ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:31.024917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a80d3-e9b9-4f1f-9c8c-fe0433c87ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:31.026339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a80d3-e9b9-4f1f-9c8c-fe0433c87ed7 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:31.035650 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 484/964] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:18:33.791841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede7673-416d-4d10-9dca-11ddeb895786 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:33.792395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede7673-416d-4d10-9dca-11ddeb895786 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:33.792395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede7673-416d-4d10-9dca-11ddeb895786 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:33.793788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 481/965] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:33.799751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d85fc5-b4f9-4220-80f6-76d466bd8fc1 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:33.800253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d85fc5-b4f9-4220-80f6-76d466bd8fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:33.800347 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d85fc5-b4f9-4220-80f6-76d466bd8fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:33.820324 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-75d85fc5-b4f9-4220-80f6-76d466bd8fc1 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:33.821544 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-75d85fc5-b4f9-4220-80f6-76d466bd8fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:33.830008 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 485/966] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:33 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:34.178036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede7673-416d-4d10-9dca-11ddeb895786 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:34.189241 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede7673-416d-4d10-9dca-11ddeb895786 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:34.192930 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5b77-9a7b-446f-89f7-a5afd05c7701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:34.193598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5b77-9a7b-446f-89f7-a5afd05c7701 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:34.193827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5b77-9a7b-446f-89f7-a5afd05c7701 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:34.194098 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5b77-9a7b-446f-89f7-a5afd05c7701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:34.203835 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb5b77-9a7b-446f-89f7-a5afd05c7701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:34.205311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb5b77-9a7b-446f-89f7-a5afd05c7701 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:34.215029 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 482/967] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:34 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:38.358110 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7dde5-1c24-4695-b899-c7430ad5ca93 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:38.358601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7dde5-1c24-4695-b899-c7430ad5ca93 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:38.358724 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7dde5-1c24-4695-b899-c7430ad5ca93 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:38.360470 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 486/968] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:38.365943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448809bc-be5c-4182-b321-b19ebb63bb7e None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:38.366372 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448809bc-be5c-4182-b321-b19ebb63bb7e None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:38.366473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448809bc-be5c-4182-b321-b19ebb63bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:38.373681 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=54 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:18:38.386652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-448809bc-be5c-4182-b321-b19ebb63bb7e None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:38.387836 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-448809bc-be5c-4182-b321-b19ebb63bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:38.395588 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 483/969] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:38.733981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7dde5-1c24-4695-b899-c7430ad5ca93 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:38.745766 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7dde5-1c24-4695-b899-c7430ad5ca93 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:38.749466 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf2eae-b838-46ab-a27b-a15fafecda01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:38.750157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2eae-b838-46ab-a27b-a15fafecda01 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:38.750625 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2eae-b838-46ab-a27b-a15fafecda01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:38.750970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2eae-b838-46ab-a27b-a15fafecda01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:38.761330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf2eae-b838-46ab-a27b-a15fafecda01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:38.763038 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf2eae-b838-46ab-a27b-a15fafecda01 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:38.782245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 487/970] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:44.251505 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a4c7-5b02-441b-845d-e8a9d409d7fb None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:44.252420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a4c7-5b02-441b-845d-e8a9d409d7fb None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:44.252875 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a4c7-5b02-441b-845d-e8a9d409d7fb None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:44.254655 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 484/971] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:44.259294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb95565-2ba3-43ab-a0a1-3b780c3575f3 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:44.260071 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb95565-2ba3-43ab-a0a1-3b780c3575f3 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:44.260518 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb95565-2ba3-43ab-a0a1-3b780c3575f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:44.349559 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-6fb95565-2ba3-43ab-a0a1-3b780c3575f3 None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:44.351076 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-6fb95565-2ba3-43ab-a0a1-3b780c3575f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:44.430960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 488/972] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:18:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:18:48.382113 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=2 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:18:48.961212 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b4a8b-97ae-41b7-a340-8a47ba3f5105 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:48.961570 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b4a8b-97ae-41b7-a340-8a47ba3f5105 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:48.961825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b4a8b-97ae-41b7-a340-8a47ba3f5105 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:48.963296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 485/973] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:48.968266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d609f-89bd-4c06-9632-51660e767acb None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:48.968928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d609f-89bd-4c06-9632-51660e767acb None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:48.968928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d609f-89bd-4c06-9632-51660e767acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:48.989175 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-993d609f-89bd-4c06-9632-51660e767acb None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:48.990383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-993d609f-89bd-4c06-9632-51660e767acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:48.999088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 489/974] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:18:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:50.643219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640cf3c-1102-4d1d-b8fa-a326a8669152 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:50.644209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640cf3c-1102-4d1d-b8fa-a326a8669152 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:50.644209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640cf3c-1102-4d1d-b8fa-a326a8669152 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:50.645157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 486/975] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:50.651168 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a192-a6ac-4433-a640-26901c317d8a None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:50.652061 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a192-a6ac-4433-a640-26901c317d8a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:50.652061 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a192-a6ac-4433-a640-26901c317d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:50.672838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-66f4a192-a6ac-4433-a640-26901c317d8a None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:50.674046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-66f4a192-a6ac-4433-a640-26901c317d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:50.682470 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 490/976] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:18:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:18:54.548000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f9f4-a618-4173-88e2-315398befba4 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:54.548428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f9f4-a618-4173-88e2-315398befba4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:54.548611 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f9f4-a618-4173-88e2-315398befba4 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:54.557115 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5672d1-a1e7-42de-8640-e358f288b46b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:54.557623 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5672d1-a1e7-42de-8640-e358f288b46b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:54.557721 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5672d1-a1e7-42de-8640-e358f288b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:54.566145 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 487/977] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:54 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:54.586561 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-1f5672d1-a1e7-42de-8640-e358f288b46b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:54.588164 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1f5672d1-a1e7-42de-8640-e358f288b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:54.598068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 491/978] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:54.962484 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b28a-cda1-489c-88dc-3c4e220fb557 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:54.963056 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b28a-cda1-489c-88dc-3c4e220fb557 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:54.963704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b28a-cda1-489c-88dc-3c4e220fb557 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:54.965359 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 488/979] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 18 19:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:54.974239 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15aab-8e38-46c2-a454-af64661fcccf None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:54.974842 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15aab-8e38-46c2-a454-af64661fcccf None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:54.975339 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15aab-8e38-46c2-a454-af64661fcccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:55.018943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-02b15aab-8e38-46c2-a454-af64661fcccf None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:55.020519 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-02b15aab-8e38-46c2-a454-af64661fcccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:55.096763 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=100 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:18:55.108337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 492/980] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 18 19:18:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:55.111926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b28a-cda1-489c-88dc-3c4e220fb557 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:55.127073 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b28a-cda1-489c-88dc-3c4e220fb557 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:55.132361 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a910-749f-4979-87c1-aa47e33f9a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:55.132915 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a910-749f-4979-87c1-aa47e33f9a16 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:55.133204 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a910-749f-4979-87c1-aa47e33f9a16 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:55.133476 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a910-749f-4979-87c1-aa47e33f9a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:55.142913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399a910-749f-4979-87c1-aa47e33f9a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:55.144669 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399a910-749f-4979-87c1-aa47e33f9a16 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:55.154893 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 489/981] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:18:57.561100 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6dcf6-6ff3-4195-abbe-9d8f1bd154e2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:57.561637 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6dcf6-6ff3-4195-abbe-9d8f1bd154e2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:57.561637 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6dcf6-6ff3-4195-abbe-9d8f1bd154e2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:57.563826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 493/982] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:18:57.568983 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51b42-91d6-4bc3-a09d-9589d2fa6085 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:57.569415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51b42-91d6-4bc3-a09d-9589d2fa6085 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:57.569531 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51b42-91d6-4bc3-a09d-9589d2fa6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:57.589446 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-3fb51b42-91d6-4bc3-a09d-9589d2fa6085 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:18:57.590887 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-3fb51b42-91d6-4bc3-a09d-9589d2fa6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:18:57.600415 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 490/983] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:18:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:18:57.948615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6dcf6-6ff3-4195-abbe-9d8f1bd154e2 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:18:57.962939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6dcf6-6ff3-4195-abbe-9d8f1bd154e2 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:18:57.968149 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6b8e2-d49d-4b9d-9aba-245a273e20a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:18:57.968784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b8e2-d49d-4b9d-9aba-245a273e20a6 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:18:57.969068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b8e2-d49d-4b9d-9aba-245a273e20a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:18:57.969340 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b8e2-d49d-4b9d-9aba-245a273e20a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:18:57.978166 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6b8e2-d49d-4b9d-9aba-245a273e20a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:18:57.980012 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6b8e2-d49d-4b9d-9aba-245a273e20a6 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:18:57.990510 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 494/984] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:18:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:00.590826 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb151-8d7a-4d93-a1bf-94f2e3243c8d None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:00.591268 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb151-8d7a-4d93-a1bf-94f2e3243c8d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:00.591364 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb151-8d7a-4d93-a1bf-94f2e3243c8d None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:00.592990 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 491/985] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:00.599088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e399f02-093f-42e8-8a2d-9243c23b4ba2 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:00.599543 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e399f02-093f-42e8-8a2d-9243c23b4ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:00.599641 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e399f02-093f-42e8-8a2d-9243c23b4ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:00.619622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-5e399f02-093f-42e8-8a2d-9243c23b4ba2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:00.620835 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-5e399f02-093f-42e8-8a2d-9243c23b4ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:00.628607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 495/986] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:00.989071 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625adb1-1800-40ce-a541-3a75341844ac None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:00.989499 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625adb1-1800-40ce-a541-3a75341844ac None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:00.989789 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625adb1-1800-40ce-a541-3a75341844ac None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:00.991283 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 492/987] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 18 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:00.998483 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5ae0-89be-4a21-90b8-bea2e5755576 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:00.998786 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5ae0-89be-4a21-90b8-bea2e5755576 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:00.999087 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5ae0-89be-4a21-90b8-bea2e5755576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:01.022367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-648a5ae0-89be-4a21-90b8-bea2e5755576 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:01.023509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-648a5ae0-89be-4a21-90b8-bea2e5755576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:01.034367 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 496/988] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 18 19:19:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:19:01.042220 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625adb1-1800-40ce-a541-3a75341844ac None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:01.057752 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625adb1-1800-40ce-a541-3a75341844ac None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:01.064335 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc422f-1daf-423e-8bbb-ff4c33c8ae1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:01.065004 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc422f-1daf-423e-8bbb-ff4c33c8ae1c service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:01.065278 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc422f-1daf-423e-8bbb-ff4c33c8ae1c service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:01.065547 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc422f-1daf-423e-8bbb-ff4c33c8ae1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:01.074767 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc422f-1daf-423e-8bbb-ff4c33c8ae1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:01.076372 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc422f-1daf-423e-8bbb-ff4c33c8ae1c service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:01.087827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 493/989] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:03.401116 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16032c-6b49-4c46-a79b-35c56cdff188 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:03.402218 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16032c-6b49-4c46-a79b-35c56cdff188 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:03.402928 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16032c-6b49-4c46-a79b-35c56cdff188 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:03.409723 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 497/990] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:03.411136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ce86c-1758-4599-a06c-7940974c930d None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:03.411965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ce86c-1758-4599-a06c-7940974c930d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:03.412512 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ce86c-1758-4599-a06c-7940974c930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:03.433419 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-590ce86c-1758-4599-a06c-7940974c930d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:03.434920 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-590ce86c-1758-4599-a06c-7940974c930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:03.443508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 494/991] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:19:03.834839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16032c-6b49-4c46-a79b-35c56cdff188 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:03.856491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16032c-6b49-4c46-a79b-35c56cdff188 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:03.862613 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc0f44-81cc-4682-b725-69bb18074a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:03.863535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc0f44-81cc-4682-b725-69bb18074a43 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:03.864034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc0f44-81cc-4682-b725-69bb18074a43 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:03.864534 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc0f44-81cc-4682-b725-69bb18074a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:03.879414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc0f44-81cc-4682-b725-69bb18074a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:03.881405 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc0f44-81cc-4682-b725-69bb18074a43 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:03.892024 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 498/992] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:05.101413 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d8522-ba69-43b3-839e-6ade6651dc08 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:05.103671 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d8522-ba69-43b3-839e-6ade6651dc08 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:05.105391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d8522-ba69-43b3-839e-6ade6651dc08 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:05.115433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2002-b352-4a7d-85ec-c7dedf152c75 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:05.115887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2002-b352-4a7d-85ec-c7dedf152c75 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:05.116118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2002-b352-4a7d-85ec-c7dedf152c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:05.120389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 495/993] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:05 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:05.167608 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-e0cf2002-b352-4a7d-85ec-c7dedf152c75 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:05.171030 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-e0cf2002-b352-4a7d-85ec-c7dedf152c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:05.198160 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 499/994] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:05.779891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336684-4f3f-4eaf-9cbd-3a7d94fdfa3d None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:05.780172 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336684-4f3f-4eaf-9cbd-3a7d94fdfa3d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:05.780617 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336684-4f3f-4eaf-9cbd-3a7d94fdfa3d None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:05.782765 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 496/995] 10.222.0.46 () {54 vars in 964 bytes} [Thu Aug 18 19:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:05.787647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fcb99-ea48-4fb9-8fbf-f16bd117529a None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:05.788120 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fcb99-ea48-4fb9-8fbf-f16bd117529a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:05.788397 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fcb99-ea48-4fb9-8fbf-f16bd117529a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:05.827993 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-f52fcb99-ea48-4fb9-8fbf-f16bd117529a None None] MFA Rules not processed for user `c92ff75ad2d142e1951491932002b036`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:05.829226 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f52fcb99-ea48-4fb9-8fbf-f16bd117529a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:05.897780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 500/996] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Aug 18 19:19:05 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:05.905163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336684-4f3f-4eaf-9cbd-3a7d94fdfa3d None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:05.916996 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336684-4f3f-4eaf-9cbd-3a7d94fdfa3d None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:05.920580 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce70c5-edb8-4e02-b263-c44b1846aae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92ff75ad2d142e1951491932002b036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:05.921233 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce70c5-edb8-4e02-b263-c44b1846aae7 service cinder] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:05.921506 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce70c5-edb8-4e02-b263-c44b1846aae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:05.922524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce70c5-edb8-4e02-b263-c44b1846aae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:05.932177 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce70c5-edb8-4e02-b263-c44b1846aae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:05.933643 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce70c5-edb8-4e02-b263-c44b1846aae7 service cinder] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:05.943551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 497/997] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:06.293958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992cb6-9be1-45f1-8906-6581e2f7ce39 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:06.293958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992cb6-9be1-45f1-8906-6581e2f7ce39 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:06.294700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992cb6-9be1-45f1-8906-6581e2f7ce39 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:06.295356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 501/998] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:06.300822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25526-8897-4cdc-844e-47caf57cc7b1 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:06.301382 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25526-8897-4cdc-844e-47caf57cc7b1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:06.301382 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25526-8897-4cdc-844e-47caf57cc7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:06.322473 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-25d25526-8897-4cdc-844e-47caf57cc7b1 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:06.323714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-25d25526-8897-4cdc-844e-47caf57cc7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:06.332935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 498/999] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:06.701384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992cb6-9be1-45f1-8906-6581e2f7ce39 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:06.724654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992cb6-9be1-45f1-8906-6581e2f7ce39 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:06.730215 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30f3f8-4820-4748-81ee-a6494f39d06b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:06.730845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30f3f8-4820-4748-81ee-a6494f39d06b service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:06.731128 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30f3f8-4820-4748-81ee-a6494f39d06b service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:06.731456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30f3f8-4820-4748-81ee-a6494f39d06b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:06.743446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30f3f8-4820-4748-81ee-a6494f39d06b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:06.745887 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30f3f8-4820-4748-81ee-a6494f39d06b service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:06.758021 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 502/1000] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:09.030642 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2356-6222-4e58-867d-4d765fe0c009 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:09.031725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2356-6222-4e58-867d-4d765fe0c009 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:09.031725 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2356-6222-4e58-867d-4d765fe0c009 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:09.033144 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 499/1001] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:09.038442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1a1a-0c79-466b-a553-be47b9d7921f None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:09.038877 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1a1a-0c79-466b-a553-be47b9d7921f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:09.038994 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1a1a-0c79-466b-a553-be47b9d7921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:09.058079 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ff7b1a1a-0c79-466b-a553-be47b9d7921f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:09.059274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ff7b1a1a-0c79-466b-a553-be47b9d7921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:09.067023 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 503/1002] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:09.419054 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf2356-6222-4e58-867d-4d765fe0c009 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:09.444560 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf2356-6222-4e58-867d-4d765fe0c009 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:09.450685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07936f2e-35b7-4219-b31d-2de891d060ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:09.451422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936f2e-35b7-4219-b31d-2de891d060ea service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:09.451782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936f2e-35b7-4219-b31d-2de891d060ea service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:09.452125 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936f2e-35b7-4219-b31d-2de891d060ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:09.462597 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07936f2e-35b7-4219-b31d-2de891d060ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:09.464116 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07936f2e-35b7-4219-b31d-2de891d060ea service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:09.474293 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 500/1003] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:11.753626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d5f2-ba39-43bd-85f5-1a7f3d26ab80 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:11.754199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d5f2-ba39-43bd-85f5-1a7f3d26ab80 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:11.754199 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d5f2-ba39-43bd-85f5-1a7f3d26ab80 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:11.755503 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 504/1004] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:11.761026 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072940b-43fd-4123-94f0-89f378ad75e3 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:11.761430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072940b-43fd-4123-94f0-89f378ad75e3 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:11.761587 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072940b-43fd-4123-94f0-89f378ad75e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:11.781786 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-1072940b-43fd-4123-94f0-89f378ad75e3 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:11.782992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-1072940b-43fd-4123-94f0-89f378ad75e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:11.793972 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 501/1005] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:12.157442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d5f2-ba39-43bd-85f5-1a7f3d26ab80 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:12.172958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d5f2-ba39-43bd-85f5-1a7f3d26ab80 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:12.178165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fb36c-a9b9-4e69-b69c-3d364b4d37d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:12.178852 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb36c-a9b9-4e69-b69c-3d364b4d37d4 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:12.179287 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb36c-a9b9-4e69-b69c-3d364b4d37d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:12.179566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb36c-a9b9-4e69-b69c-3d364b4d37d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:12.189750 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb36c-a9b9-4e69-b69c-3d364b4d37d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:12.191344 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb36c-a9b9-4e69-b69c-3d364b4d37d4 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:12.202982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 505/1006] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:14.502219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b3a0-3e65-4b20-9526-bbd5e14da4fa None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:14.503827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b3a0-3e65-4b20-9526-bbd5e14da4fa None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:14.503827 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b3a0-3e65-4b20-9526-bbd5e14da4fa None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:14.504257 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 502/1007] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:14.511672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879896f-c977-463f-aaf0-997f09e4650b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:14.512380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879896f-c977-463f-aaf0-997f09e4650b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:14.512380 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879896f-c977-463f-aaf0-997f09e4650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:14.533767 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-7879896f-c977-463f-aaf0-997f09e4650b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:14.535061 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-7879896f-c977-463f-aaf0-997f09e4650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:14.543742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 506/1008] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:19:14.988898 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b3a0-3e65-4b20-9526-bbd5e14da4fa None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:15.005779 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b3a0-3e65-4b20-9526-bbd5e14da4fa None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:15.012122 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4cd61-b1d4-4d23-8abd-3668c19fc95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:15.012988 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cd61-b1d4-4d23-8abd-3668c19fc95e service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:15.013345 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cd61-b1d4-4d23-8abd-3668c19fc95e service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:15.013696 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cd61-b1d4-4d23-8abd-3668c19fc95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:15.026548 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4cd61-b1d4-4d23-8abd-3668c19fc95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:15.030602 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4cd61-b1d4-4d23-8abd-3668c19fc95e service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:15.044481 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 503/1009] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:19:17.378397 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478671-c4d6-43c1-ba81-7b72807f1587 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:17.379064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478671-c4d6-43c1-ba81-7b72807f1587 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:17.379064 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478671-c4d6-43c1-ba81-7b72807f1587 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:17.380288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 507/1010] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:17.386722 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f03c5-8372-4feb-aea5-4e489e17e328 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:17.387338 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f03c5-8372-4feb-aea5-4e489e17e328 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:17.387528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f03c5-8372-4feb-aea5-4e489e17e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:17.411314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-977f03c5-8372-4feb-aea5-4e489e17e328 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:17.412937 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-977f03c5-8372-4feb-aea5-4e489e17e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:17.423176 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 504/1011] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:17.810005 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478671-c4d6-43c1-ba81-7b72807f1587 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:17.825656 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478671-c4d6-43c1-ba81-7b72807f1587 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:17.831008 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcf118-c476-48f3-9250-ceb4d69f0b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:17.831619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcf118-c476-48f3-9250-ceb4d69f0b31 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:17.831900 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcf118-c476-48f3-9250-ceb4d69f0b31 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:17.832178 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcf118-c476-48f3-9250-ceb4d69f0b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:17.840998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcf118-c476-48f3-9250-ceb4d69f0b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:17.842660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcf118-c476-48f3-9250-ceb4d69f0b31 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:17.861123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 508/1012] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:20.803814 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a355c1-291c-4ffe-84c8-44eac5d4fba1 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:20.804536 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a355c1-291c-4ffe-84c8-44eac5d4fba1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:20.804536 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a355c1-291c-4ffe-84c8-44eac5d4fba1 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:20.808495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 505/1013] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:20.814646 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c772-d64a-4564-85e2-e17a38d1e0bd None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:20.815156 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c772-d64a-4564-85e2-e17a38d1e0bd None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:20.815156 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c772-d64a-4564-85e2-e17a38d1e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:20.834665 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-7dc0c772-d64a-4564-85e2-e17a38d1e0bd None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:20.835862 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-7dc0c772-d64a-4564-85e2-e17a38d1e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:20.843627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 509/1014] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:21.210783 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a355c1-291c-4ffe-84c8-44eac5d4fba1 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:21.218157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=46 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:19:21.225214 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a355c1-291c-4ffe-84c8-44eac5d4fba1 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:21.231799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35576b7-5278-426d-97da-964c388f9a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:21.232408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35576b7-5278-426d-97da-964c388f9a60 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:21.232710 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35576b7-5278-426d-97da-964c388f9a60 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:21.232986 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35576b7-5278-426d-97da-964c388f9a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:21.241744 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35576b7-5278-426d-97da-964c388f9a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:21.243309 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35576b7-5278-426d-97da-964c388f9a60 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:21.253318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 506/1015] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:22.098227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9518c-723e-4d8f-96f5-d949f01a90c4 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:22.098803 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9518c-723e-4d8f-96f5-d949f01a90c4 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:22.098803 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9518c-723e-4d8f-96f5-d949f01a90c4 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:22.100165 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 510/1016] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:19:22.105799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce047d3-caa9-47ca-8f45-077f05a302de None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:22.106217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce047d3-caa9-47ca-8f45-077f05a302de None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:22.106351 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce047d3-caa9-47ca-8f45-077f05a302de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:22.126200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-bce047d3-caa9-47ca-8f45-077f05a302de None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:22.127384 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-bce047d3-caa9-47ca-8f45-077f05a302de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:22.135105 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 507/1017] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:22.492695 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0086-10c5-43be-848d-c736db18a284 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:22.493003 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0086-10c5-43be-848d-c736db18a284 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:22.493280 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0086-10c5-43be-848d-c736db18a284 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:22.494575 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 511/1018] 10.222.0.46 () {54 vars in 967 bytes} [Thu Aug 18 19:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:22.499524 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb7fda-a9d1-4449-83e8-ef2c79aad69c None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:22.499820 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb7fda-a9d1-4449-83e8-ef2c79aad69c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:22.500663 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb7fda-a9d1-4449-83e8-ef2c79aad69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:22.540238 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-93eb7fda-a9d1-4449-83e8-ef2c79aad69c None None] MFA Rules not processed for user `01123f6512bb4554bf757a1ca0cc46da`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:22.541472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-93eb7fda-a9d1-4449-83e8-ef2c79aad69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:22.610080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 508/1019] 10.222.0.46 () {58 vars in 1064 bytes} [Thu Aug 18 19:19:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:22.617638 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d0086-10c5-43be-848d-c736db18a284 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:22.629114 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d0086-10c5-43be-848d-c736db18a284 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:22.632545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b707c-1449-4293-8d78-53448a121be9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01123f6512bb4554bf757a1ca0cc46da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:22.633227 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b707c-1449-4293-8d78-53448a121be9 service glance] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:22.633515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b707c-1449-4293-8d78-53448a121be9 service glance] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:22.633789 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b707c-1449-4293-8d78-53448a121be9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:22.643498 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b707c-1449-4293-8d78-53448a121be9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:22.645054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b707c-1449-4293-8d78-53448a121be9 service glance] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:22.655013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 512/1020] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:23.519120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb431-9683-404c-aca5-a33041dccc57 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:23.520064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb431-9683-404c-aca5-a33041dccc57 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:23.520064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb431-9683-404c-aca5-a33041dccc57 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:23.521965 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 509/1021] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:19:23.531086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9ca2-9392-4036-aa73-72be593bba08 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:23.531738 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9ca2-9392-4036-aa73-72be593bba08 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:23.532102 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9ca2-9392-4036-aa73-72be593bba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:23.568259 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-06ae9ca2-9392-4036-aa73-72be593bba08 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:23.569654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-06ae9ca2-9392-4036-aa73-72be593bba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:23.581078 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 513/1022] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:23.939193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb431-9683-404c-aca5-a33041dccc57 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:23.980095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb431-9683-404c-aca5-a33041dccc57 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:23.985638 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2e2a-f569-4def-9994-468f3fdf9003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:23.986253 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2e2a-f569-4def-9994-468f3fdf9003 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:23.986532 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2e2a-f569-4def-9994-468f3fdf9003 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:23.986802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2e2a-f569-4def-9994-468f3fdf9003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:23.996775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2e2a-f569-4def-9994-468f3fdf9003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:23.998374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2e2a-f569-4def-9994-468f3fdf9003 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:24.009719 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 510/1023] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:19:26.335622 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4f4d-0738-4b6c-ac52-1046cdc169a3 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:26.336285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4f4d-0738-4b6c-ac52-1046cdc169a3 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:26.336285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4f4d-0738-4b6c-ac52-1046cdc169a3 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:26.337911 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 514/1024] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:26.344782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87f50-b09e-4b5e-ab0f-c55669722e6a None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:26.345656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87f50-b09e-4b5e-ab0f-c55669722e6a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:26.345656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87f50-b09e-4b5e-ab0f-c55669722e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:26.367936 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-90a87f50-b09e-4b5e-ab0f-c55669722e6a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:26.369301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-90a87f50-b09e-4b5e-ab0f-c55669722e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:26.377221 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 511/1025] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:19:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:26.783943 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4f4d-0738-4b6c-ac52-1046cdc169a3 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:26.792333 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=92 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:19:26.802086 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4f4d-0738-4b6c-ac52-1046cdc169a3 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:26.807328 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c8bc9-0dff-497f-9aec-a3d1b2a4fa97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:26.807957 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c8bc9-0dff-497f-9aec-a3d1b2a4fa97 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:26.808237 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c8bc9-0dff-497f-9aec-a3d1b2a4fa97 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:26.808512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c8bc9-0dff-497f-9aec-a3d1b2a4fa97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:26.817951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c8bc9-0dff-497f-9aec-a3d1b2a4fa97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:26.819742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c8bc9-0dff-497f-9aec-a3d1b2a4fa97 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:26.830192 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 515/1026] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:36.362839 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=50 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:19:36.825698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=5 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:19:38.286388 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1faa9-7b76-464b-9c10-0b5d2406c017 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:38.287007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1faa9-7b76-464b-9c10-0b5d2406c017 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:38.287007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1faa9-7b76-464b-9c10-0b5d2406c017 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:38.288278 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 512/1027] 10.222.0.46 () {54 vars in 918 bytes} [Thu Aug 18 19:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:38.294009 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9060260-40f4-4c12-b807-87f260ac2d0c None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:38.294496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9060260-40f4-4c12-b807-87f260ac2d0c None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:38.294595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9060260-40f4-4c12-b807-87f260ac2d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:38.315596 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-c9060260-40f4-4c12-b807-87f260ac2d0c None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:38.316869 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-c9060260-40f4-4c12-b807-87f260ac2d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:38.325632 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 516/1028] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Aug 18 19:19:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:38.339909 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604176-5bee-4db2-af93-0c9618a32058 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:38.340189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604176-5bee-4db2-af93-0c9618a32058 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:38.340477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604176-5bee-4db2-af93-0c9618a32058 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:38.341816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 513/1029] 10.222.0.46 () {54 vars in 918 bytes} [Thu Aug 18 19:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:38.346573 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b666-c832-4929-8c3d-2800df026309 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:38.346854 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b666-c832-4929-8c3d-2800df026309 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:38.347129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b666-c832-4929-8c3d-2800df026309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:38.367785 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-8058b666-c832-4929-8c3d-2800df026309 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:38.369010 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-8058b666-c832-4929-8c3d-2800df026309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:38.377404 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 517/1030] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Aug 18 19:19:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:41.163877 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4da7a-7d17-42da-8288-6202a61d7cea None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:41.164500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4da7a-7d17-42da-8288-6202a61d7cea None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:41.164500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4da7a-7d17-42da-8288-6202a61d7cea None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:41.165933 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:41.172551 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74215cf4-b6e0-4a15-af37-3b622bc83a86 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:41.173454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74215cf4-b6e0-4a15-af37-3b622bc83a86 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:41.173454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74215cf4-b6e0-4a15-af37-3b622bc83a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:41.193545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-74215cf4-b6e0-4a15-af37-3b622bc83a86 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:41.194745 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-74215cf4-b6e0-4a15-af37-3b622bc83a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:41.203769 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:19:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:19:41.556036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4da7a-7d17-42da-8288-6202a61d7cea None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:41.570195 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4da7a-7d17-42da-8288-6202a61d7cea None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:41.575696 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c50427-f49f-4f0a-8100-702ce4ad2f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:41.576327 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c50427-f49f-4f0a-8100-702ce4ad2f3f service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:41.576607 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c50427-f49f-4f0a-8100-702ce4ad2f3f service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:41.576909 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c50427-f49f-4f0a-8100-702ce4ad2f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:41.585784 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c50427-f49f-4f0a-8100-702ce4ad2f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:41.587390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c50427-f49f-4f0a-8100-702ce4ad2f3f service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:41.597885 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 515/1033] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:42.577834 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765705-8e87-4ec7-9036-1f4ad258f0a6 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:42.578276 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765705-8e87-4ec7-9036-1f4ad258f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:42.578508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765705-8e87-4ec7-9036-1f4ad258f0a6 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:42.580777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:42.585744 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3fd21-60f0-4d03-8124-055e1f4a8e3b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:42.586227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3fd21-60f0-4d03-8124-055e1f4a8e3b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:42.586334 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3fd21-60f0-4d03-8124-055e1f4a8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:42.605993 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-63f3fd21-60f0-4d03-8124-055e1f4a8e3b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:42.607198 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-63f3fd21-60f0-4d03-8124-055e1f4a8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:42.614946 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:42.806044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55765705-8e87-4ec7-9036-1f4ad258f0a6 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:42.820916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55765705-8e87-4ec7-9036-1f4ad258f0a6 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:42.825998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87c83a-7cd7-4e81-b811-e1630428d747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:42.826532 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87c83a-7cd7-4e81-b811-e1630428d747 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:42.826795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87c83a-7cd7-4e81-b811-e1630428d747 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:42.827065 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87c83a-7cd7-4e81-b811-e1630428d747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:42.834985 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87c83a-7cd7-4e81-b811-e1630428d747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:42.836584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87c83a-7cd7-4e81-b811-e1630428d747 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:42.846445 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 520/1036] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:43.766585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764df3d-9dc2-4306-ae40-31b642068dc2 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:43.767193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764df3d-9dc2-4306-ae40-31b642068dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:43.767193 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764df3d-9dc2-4306-ae40-31b642068dc2 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:43.768545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:43.773673 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94775-74d0-4210-a906-ea8df907bf7a None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:43.774109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94775-74d0-4210-a906-ea8df907bf7a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:43.774407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94775-74d0-4210-a906-ea8df907bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:43.795893 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-f0d94775-74d0-4210-a906-ea8df907bf7a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:43.797672 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f0d94775-74d0-4210-a906-ea8df907bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:43.805392 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:43.973059 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764df3d-9dc2-4306-ae40-31b642068dc2 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:43.987928 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764df3d-9dc2-4306-ae40-31b642068dc2 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:43.992834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b32ee-8968-49c8-8d4a-d4fb91cd7b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:43.993423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b32ee-8968-49c8-8d4a-d4fb91cd7b59 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:43.993698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b32ee-8968-49c8-8d4a-d4fb91cd7b59 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:43.994049 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b32ee-8968-49c8-8d4a-d4fb91cd7b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:44.001985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b32ee-8968-49c8-8d4a-d4fb91cd7b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:44.003534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b32ee-8968-49c8-8d4a-d4fb91cd7b59 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:44.012585 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 518/1039] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:44.894080 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5400b-7b4d-4463-90c6-de4d6d8ce63c None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:44.894662 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5400b-7b4d-4463-90c6-de4d6d8ce63c None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:44.894662 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5400b-7b4d-4463-90c6-de4d6d8ce63c None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:44.895962 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:44.900973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6673da-128c-4eb8-aca9-f166a68f06e2 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:44.901405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6673da-128c-4eb8-aca9-f166a68f06e2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:44.901500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6673da-128c-4eb8-aca9-f166a68f06e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:44.920825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-ad6673da-128c-4eb8-aca9-f166a68f06e2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:44.922557 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-ad6673da-128c-4eb8-aca9-f166a68f06e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:44.930300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:45.084206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5400b-7b4d-4463-90c6-de4d6d8ce63c None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:45.098975 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5400b-7b4d-4463-90c6-de4d6d8ce63c None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:45.103998 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e0c50-681f-4f78-b36a-e90a6c255ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:45.104886 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e0c50-681f-4f78-b36a-e90a6c255ec5 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:45.105170 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e0c50-681f-4f78-b36a-e90a6c255ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:45.105447 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e0c50-681f-4f78-b36a-e90a6c255ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:45.113627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e0c50-681f-4f78-b36a-e90a6c255ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:45.115779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e0c50-681f-4f78-b36a-e90a6c255ec5 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:45.126016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 523/1042] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:45.991801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546d46-90dc-4053-b888-ca923f5ca0ae None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:45.992350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546d46-90dc-4053-b888-ca923f5ca0ae None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:45.992350 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546d46-90dc-4053-b888-ca923f5ca0ae None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:45.993620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:45.998626 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be68f-acc5-4dfd-82e7-c809f5b468df None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:45.999059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be68f-acc5-4dfd-82e7-c809f5b468df None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:45.999168 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be68f-acc5-4dfd-82e7-c809f5b468df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:46.018593 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-a88be68f-acc5-4dfd-82e7-c809f5b468df None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:46.019810 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-a88be68f-acc5-4dfd-82e7-c809f5b468df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:46.027644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:19:46.188807 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c546d46-90dc-4053-b888-ca923f5ca0ae None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:46.202311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c546d46-90dc-4053-b888-ca923f5ca0ae None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:46.207700 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f6fa-9922-42e6-92a5-9d914b522a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:46.208290 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f6fa-9922-42e6-92a5-9d914b522a70 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:46.208570 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f6fa-9922-42e6-92a5-9d914b522a70 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:46.208869 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f6fa-9922-42e6-92a5-9d914b522a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:46.216801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f6fa-9922-42e6-92a5-9d914b522a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:46.218356 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f6fa-9922-42e6-92a5-9d914b522a70 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:46.227420 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 521/1045] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:47.033285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21d2f0-f8b7-4e28-8309-e514521776ec None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:47.033851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21d2f0-f8b7-4e28-8309-e514521776ec None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:47.033980 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21d2f0-f8b7-4e28-8309-e514521776ec None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:47.035249 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:47.040157 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c9f2-1889-4167-bc48-af8689da9d91 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:47.040570 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c9f2-1889-4167-bc48-af8689da9d91 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:47.040777 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c9f2-1889-4167-bc48-af8689da9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:47.060454 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-0350c9f2-1889-4167-bc48-af8689da9d91 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:47.061705 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-0350c9f2-1889-4167-bc48-af8689da9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:47.070012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:47.227509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21d2f0-f8b7-4e28-8309-e514521776ec None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:47.242157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21d2f0-f8b7-4e28-8309-e514521776ec None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:47.247951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3db4a3-4391-4da8-84d1-bd0b834ad6a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:47.248545 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db4a3-4391-4da8-84d1-bd0b834ad6a9 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:47.248920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db4a3-4391-4da8-84d1-bd0b834ad6a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:47.249197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db4a3-4391-4da8-84d1-bd0b834ad6a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:47.258279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3db4a3-4391-4da8-84d1-bd0b834ad6a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:47.259856 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3db4a3-4391-4da8-84d1-bd0b834ad6a9 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:47.270317 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 526/1048] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:48.076627 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f2a6-2b2f-438a-86d9-95bfbf22cea4 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:48.077250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f2a6-2b2f-438a-86d9-95bfbf22cea4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:48.077250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f2a6-2b2f-438a-86d9-95bfbf22cea4 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:48.078943 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:48.083771 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d4256-1a38-47b7-a0c1-026ef8fdb9a0 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:48.084252 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d4256-1a38-47b7-a0c1-026ef8fdb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:48.084363 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d4256-1a38-47b7-a0c1-026ef8fdb9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:48.103758 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-6d7d4256-1a38-47b7-a0c1-026ef8fdb9a0 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:48.105402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-6d7d4256-1a38-47b7-a0c1-026ef8fdb9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:48.113195 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:48.268793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749f2a6-2b2f-438a-86d9-95bfbf22cea4 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:48.282593 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749f2a6-2b2f-438a-86d9-95bfbf22cea4 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:48.287559 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86523e8e-3cee-43d4-8bbe-b687a0d8aa58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:48.288275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86523e8e-3cee-43d4-8bbe-b687a0d8aa58 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:48.288556 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86523e8e-3cee-43d4-8bbe-b687a0d8aa58 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:48.288864 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86523e8e-3cee-43d4-8bbe-b687a0d8aa58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:48.296815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86523e8e-3cee-43d4-8bbe-b687a0d8aa58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:48.298417 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86523e8e-3cee-43d4-8bbe-b687a0d8aa58 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:48.307470 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 524/1051] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:49.107800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057c95-a8ae-4312-b935-243cc86b6caa None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:49.108392 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057c95-a8ae-4312-b935-243cc86b6caa None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:49.108392 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057c95-a8ae-4312-b935-243cc86b6caa None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:49.110276 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:49.115465 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde4c5-54d1-46b2-90a1-1824deeeccd7 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:49.115968 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde4c5-54d1-46b2-90a1-1824deeeccd7 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:49.116155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde4c5-54d1-46b2-90a1-1824deeeccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:49.135197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-50bde4c5-54d1-46b2-90a1-1824deeeccd7 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:49.136374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-50bde4c5-54d1-46b2-90a1-1824deeeccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:49.144024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:19:49.299844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057c95-a8ae-4312-b935-243cc86b6caa None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:49.315197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057c95-a8ae-4312-b935-243cc86b6caa None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:49.320482 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af87928-f568-4c97-a41b-014bf8b517f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:49.321118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af87928-f568-4c97-a41b-014bf8b517f9 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:49.321387 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af87928-f568-4c97-a41b-014bf8b517f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:49.321659 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af87928-f568-4c97-a41b-014bf8b517f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:49.330542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af87928-f568-4c97-a41b-014bf8b517f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:49.332117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af87928-f568-4c97-a41b-014bf8b517f9 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:49.341253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 529/1054] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:50.151373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60dfe-1bd6-47ca-8f62-7152a540fac2 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:50.151923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60dfe-1bd6-47ca-8f62-7152a540fac2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:50.151923 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60dfe-1bd6-47ca-8f62-7152a540fac2 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:50.153265 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:19:50.158138 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cab98-b0b4-4053-b7a0-022924bbdec2 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:50.158570 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cab98-b0b4-4053-b7a0-022924bbdec2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:50.158720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cab98-b0b4-4053-b7a0-022924bbdec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:50.179095 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ba4cab98-b0b4-4053-b7a0-022924bbdec2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:50.180306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ba4cab98-b0b4-4053-b7a0-022924bbdec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:50.188536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:19:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:50.343346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60dfe-1bd6-47ca-8f62-7152a540fac2 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:50.356907 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60dfe-1bd6-47ca-8f62-7152a540fac2 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:50.362373 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3763f-b71c-43b2-a480-b533ba4f794e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:50.362964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3763f-b71c-43b2-a480-b533ba4f794e service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:50.363248 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3763f-b71c-43b2-a480-b533ba4f794e service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:50.363523 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3763f-b71c-43b2-a480-b533ba4f794e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:50.371617 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3763f-b71c-43b2-a480-b533ba4f794e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:50.373203 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3763f-b71c-43b2-a480-b533ba4f794e service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:50.383012 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 527/1057] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:52.415305 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad418-49d5-4b01-aad4-4e55b294b4c2 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:52.415879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad418-49d5-4b01-aad4-4e55b294b4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:52.415879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad418-49d5-4b01-aad4-4e55b294b4c2 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:52.417197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:52.423070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955f574-e96c-4082-8522-ed4ca5c28a9f None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:52.423511 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955f574-e96c-4082-8522-ed4ca5c28a9f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:52.423608 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955f574-e96c-4082-8522-ed4ca5c28a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:52.442331 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-c955f574-e96c-4082-8522-ed4ca5c28a9f None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:52.443518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-c955f574-e96c-4082-8522-ed4ca5c28a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:52.451199 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:19:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:52.786200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad418-49d5-4b01-aad4-4e55b294b4c2 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:52.796951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad418-49d5-4b01-aad4-4e55b294b4c2 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:52.800491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb363a9-f135-451b-9055-568d04be73f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:52.801128 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb363a9-f135-451b-9055-568d04be73f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:52.801408 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb363a9-f135-451b-9055-568d04be73f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:52.801683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb363a9-f135-451b-9055-568d04be73f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:52.811091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb363a9-f135-451b-9055-568d04be73f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:52.812527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb363a9-f135-451b-9055-568d04be73f8 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:52.821768 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 532/1060] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:55.219948 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0c9f-1a7a-4d95-b2e9-67a4177f08cc None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:55.220610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0c9f-1a7a-4d95-b2e9-67a4177f08cc None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:55.220610 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0c9f-1a7a-4d95-b2e9-67a4177f08cc None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:55.221907 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:55.227281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434642a-2b06-4a75-b061-9b94e29fa444 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:55.227724 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434642a-2b06-4a75-b061-9b94e29fa444 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:55.227836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434642a-2b06-4a75-b061-9b94e29fa444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:55.246641 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-a434642a-2b06-4a75-b061-9b94e29fa444 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:55.247823 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-a434642a-2b06-4a75-b061-9b94e29fa444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:55.256178 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:19:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:55.593985 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0c9f-1a7a-4d95-b2e9-67a4177f08cc None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:55.604984 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0c9f-1a7a-4d95-b2e9-67a4177f08cc None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:55.608357 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934fbd-9260-4b61-80e8-2413e51198a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:55.609508 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934fbd-9260-4b61-80e8-2413e51198a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:55.609785 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934fbd-9260-4b61-80e8-2413e51198a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:55.610054 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934fbd-9260-4b61-80e8-2413e51198a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:55.618793 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934fbd-9260-4b61-80e8-2413e51198a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:55.620197 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934fbd-9260-4b61-80e8-2413e51198a8 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:55.629945 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 530/1063] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:19:58.199174 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611f4b-a2aa-4b8e-9b2d-06cf692b53a5 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:58.199764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611f4b-a2aa-4b8e-9b2d-06cf692b53a5 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:58.199764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611f4b-a2aa-4b8e-9b2d-06cf692b53a5 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:58.201067 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:19:58.206509 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f7c9c-e122-4162-bd6c-c4aee2ca2146 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:58.206929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f7c9c-e122-4162-bd6c-c4aee2ca2146 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:58.207060 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f7c9c-e122-4162-bd6c-c4aee2ca2146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:58.226306 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-649f7c9c-e122-4162-bd6c-c4aee2ca2146 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:19:58.227500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-649f7c9c-e122-4162-bd6c-c4aee2ca2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:19:58.235997 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:19:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:19:58.578471 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da611f4b-a2aa-4b8e-9b2d-06cf692b53a5 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:19:58.590492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da611f4b-a2aa-4b8e-9b2d-06cf692b53a5 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:19:58.594636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a539b-3fe3-46d9-bd78-994a774f16ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:19:58.595236 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a539b-3fe3-46d9-bd78-994a774f16ce service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:19:58.595516 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a539b-3fe3-46d9-bd78-994a774f16ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:19:58.595790 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a539b-3fe3-46d9-bd78-994a774f16ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:19:58.605183 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a539b-3fe3-46d9-bd78-994a774f16ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:19:58.606607 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a539b-3fe3-46d9-bd78-994a774f16ce service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:19:58.615753 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 535/1066] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:19:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:20:00.922687 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b2d56-8539-45b3-a9ed-8d08f88b8837 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:00.923211 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b2d56-8539-45b3-a9ed-8d08f88b8837 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:00.923211 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b2d56-8539-45b3-a9ed-8d08f88b8837 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:00.924496 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:00.929939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece17066-932e-4dbc-a5fb-67615fb30097 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:00.930382 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece17066-932e-4dbc-a5fb-67615fb30097 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:00.930483 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece17066-932e-4dbc-a5fb-67615fb30097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:00.949631 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ece17066-932e-4dbc-a5fb-67615fb30097 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:00.950820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ece17066-932e-4dbc-a5fb-67615fb30097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:00.959096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:01.307402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b2d56-8539-45b3-a9ed-8d08f88b8837 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:01.318774 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b2d56-8539-45b3-a9ed-8d08f88b8837 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:01.322353 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3e601-5b56-45fe-a09c-227d230ea6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:01.323007 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e601-5b56-45fe-a09c-227d230ea6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:01.323281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e601-5b56-45fe-a09c-227d230ea6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:01.323553 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3e601-5b56-45fe-a09c-227d230ea6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:01.333135 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3e601-5b56-45fe-a09c-227d230ea6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:01.334545 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3e601-5b56-45fe-a09c-227d230ea6e1 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:01.343665 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 533/1069] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:03.579897 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f8f0-d866-4bb0-8e21-40dcb8ed5f55 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:03.580442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f8f0-d866-4bb0-8e21-40dcb8ed5f55 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:03.580442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f8f0-d866-4bb0-8e21-40dcb8ed5f55 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:03.581800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:03.587019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffff374-5b17-4699-bf98-b686ec18ceb2 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:03.587498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffff374-5b17-4699-bf98-b686ec18ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:03.587591 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffff374-5b17-4699-bf98-b686ec18ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:03.606431 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-1ffff374-5b17-4699-bf98-b686ec18ceb2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:03.607609 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-1ffff374-5b17-4699-bf98-b686ec18ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:03.615173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:03.956984 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f8f0-d866-4bb0-8e21-40dcb8ed5f55 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:03.968254 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f8f0-d866-4bb0-8e21-40dcb8ed5f55 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:03.971819 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b93cc-1d0e-4a0e-a3cf-dfd499236d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:03.972411 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b93cc-1d0e-4a0e-a3cf-dfd499236d61 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:03.972720 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b93cc-1d0e-4a0e-a3cf-dfd499236d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:03.973006 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b93cc-1d0e-4a0e-a3cf-dfd499236d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:03.982591 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b93cc-1d0e-4a0e-a3cf-dfd499236d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:03.984025 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b93cc-1d0e-4a0e-a3cf-dfd499236d61 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:03.993751 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 538/1072] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:06.298866 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3593c-8216-4e75-8c45-da7bfb4f3bfc None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:06.299408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3593c-8216-4e75-8c45-da7bfb4f3bfc None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:06.299408 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3593c-8216-4e75-8c45-da7bfb4f3bfc None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:06.300657 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:06.305956 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d245f4-d720-4ccb-bb0e-518f33a2e23a None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:06.306406 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d245f4-d720-4ccb-bb0e-518f33a2e23a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:06.306525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d245f4-d720-4ccb-bb0e-518f33a2e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:06.325032 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-c7d245f4-d720-4ccb-bb0e-518f33a2e23a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:06.326206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-c7d245f4-d720-4ccb-bb0e-518f33a2e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:06.334290 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:06.673912 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3593c-8216-4e75-8c45-da7bfb4f3bfc None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:06.679147 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=64 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:20:06.685436 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3593c-8216-4e75-8c45-da7bfb4f3bfc None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:06.689566 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04a4c-5868-422a-bd46-90d0fd41bf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:06.690149 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04a4c-5868-422a-bd46-90d0fd41bf9b service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:06.690427 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04a4c-5868-422a-bd46-90d0fd41bf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:06.690698 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04a4c-5868-422a-bd46-90d0fd41bf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:06.699354 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04a4c-5868-422a-bd46-90d0fd41bf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:06.700801 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04a4c-5868-422a-bd46-90d0fd41bf9b service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:06.710688 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 536/1075] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:08.992252 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a286-6684-4a03-88c5-507fb9fbaf5a None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:08.992784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a286-6684-4a03-88c5-507fb9fbaf5a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:08.992784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a286-6684-4a03-88c5-507fb9fbaf5a None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:08.994109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:09.000063 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a708-ca25-4a39-8938-0847ade1f3e8 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:09.000461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a708-ca25-4a39-8938-0847ade1f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:09.000606 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a708-ca25-4a39-8938-0847ade1f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:09.019245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-5ea8a708-ca25-4a39-8938-0847ade1f3e8 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:09.020456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-5ea8a708-ca25-4a39-8938-0847ade1f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:09.027991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:09.366006 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a286-6684-4a03-88c5-507fb9fbaf5a None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:09.371457 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=73 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:20:09.378477 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a286-6684-4a03-88c5-507fb9fbaf5a None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:09.381953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45368511-4fe3-40d9-bf05-a294980fb41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:09.382542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368511-4fe3-40d9-bf05-a294980fb41c service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:09.382850 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368511-4fe3-40d9-bf05-a294980fb41c service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:09.383123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368511-4fe3-40d9-bf05-a294980fb41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:09.392489 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45368511-4fe3-40d9-bf05-a294980fb41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:09.393977 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45368511-4fe3-40d9-bf05-a294980fb41c service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:09.403216 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 541/1078] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:11.604244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296158-e8b5-4d80-9017-9e295a608c7b None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:11.605025 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296158-e8b5-4d80-9017-9e295a608c7b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:11.605137 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296158-e8b5-4d80-9017-9e295a608c7b None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:11.606465 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:11.611679 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0713-4625-495b-8123-846b785f6416 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:11.612109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0713-4625-495b-8123-846b785f6416 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:11.612216 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0713-4625-495b-8123-846b785f6416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:11.631352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-ba1e0713-4625-495b-8123-846b785f6416 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:11.632523 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ba1e0713-4625-495b-8123-846b785f6416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:11.641377 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:11.977217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296158-e8b5-4d80-9017-9e295a608c7b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:11.988578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296158-e8b5-4d80-9017-9e295a608c7b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:11.992075 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a63c9-6f77-4e12-86ac-ba24216a687b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:11.992660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a63c9-6f77-4e12-86ac-ba24216a687b service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:11.992969 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a63c9-6f77-4e12-86ac-ba24216a687b service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:11.993243 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a63c9-6f77-4e12-86ac-ba24216a687b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:12.002528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a63c9-6f77-4e12-86ac-ba24216a687b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:12.003940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a63c9-6f77-4e12-86ac-ba24216a687b service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:12.013370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 539/1081] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:14.262948 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b44ca-80ca-402e-8e70-1c4d1ca35770 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:14.263496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b44ca-80ca-402e-8e70-1c4d1ca35770 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:14.263791 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b44ca-80ca-402e-8e70-1c4d1ca35770 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:14.265754 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:14.270964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afbb44-b3dd-43f7-b992-9685d6dd2b60 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:14.271380 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afbb44-b3dd-43f7-b992-9685d6dd2b60 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:14.271515 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afbb44-b3dd-43f7-b992-9685d6dd2b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:14.290756 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-b3afbb44-b3dd-43f7-b992-9685d6dd2b60 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:14.291938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-b3afbb44-b3dd-43f7-b992-9685d6dd2b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:14.300234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:14.644866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b44ca-80ca-402e-8e70-1c4d1ca35770 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:14.655527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b44ca-80ca-402e-8e70-1c4d1ca35770 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:14.658991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79a5c0-e9ca-4439-8612-5b2a52e3c677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:14.659576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79a5c0-e9ca-4439-8612-5b2a52e3c677 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:14.659851 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79a5c0-e9ca-4439-8612-5b2a52e3c677 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:14.660121 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79a5c0-e9ca-4439-8612-5b2a52e3c677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:14.668843 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79a5c0-e9ca-4439-8612-5b2a52e3c677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:14.670283 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79a5c0-e9ca-4439-8612-5b2a52e3c677 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:14.681230 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 544/1084] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:16.880773 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424895c3-aebe-4432-8200-972b19d5183a None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:16.881301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424895c3-aebe-4432-8200-972b19d5183a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:16.881301 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424895c3-aebe-4432-8200-972b19d5183a None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:16.882579 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:16.887794 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ba0c-9fb4-4bd0-acfb-43480428e683 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:16.888249 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ba0c-9fb4-4bd0-acfb-43480428e683 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:16.888370 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ba0c-9fb4-4bd0-acfb-43480428e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:16.907934 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-6a85ba0c-9fb4-4bd0-acfb-43480428e683 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:16.909157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-6a85ba0c-9fb4-4bd0-acfb-43480428e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:16.916861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:20:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:17.255775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424895c3-aebe-4432-8200-972b19d5183a None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:17.266814 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424895c3-aebe-4432-8200-972b19d5183a None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:17.270267 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef2efa-28d7-49a1-b0ab-23b2abf976b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:17.270855 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef2efa-28d7-49a1-b0ab-23b2abf976b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:17.271135 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef2efa-28d7-49a1-b0ab-23b2abf976b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:17.271406 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef2efa-28d7-49a1-b0ab-23b2abf976b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:17.280947 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef2efa-28d7-49a1-b0ab-23b2abf976b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:17.282366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef2efa-28d7-49a1-b0ab-23b2abf976b3 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:17.291478 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 542/1087] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:26.902806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=17 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:20:27.287490 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=23 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:20:41.165549 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c0b7b-5e94-42fe-8f6c-15bbf6417828 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:41.166163 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c0b7b-5e94-42fe-8f6c-15bbf6417828 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:41.166163 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c0b7b-5e94-42fe-8f6c-15bbf6417828 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:41.167455 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 546/1088] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:41.173573 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352818cf-df82-4788-80e4-dac01ecec140 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:41.173991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352818cf-df82-4788-80e4-dac01ecec140 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:41.174112 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352818cf-df82-4788-80e4-dac01ecec140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:41.192818 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-352818cf-df82-4788-80e4-dac01ecec140 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:41.195477 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-352818cf-df82-4788-80e4-dac01ecec140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:41.204240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 543/1089] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:41.556866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f97b9-3e40-4b57-9897-49a6a7737a07 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:41.557151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f97b9-3e40-4b57-9897-49a6a7737a07 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:41.557425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f97b9-3e40-4b57-9897-49a6a7737a07 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:41.558746 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 547/1090] 10.222.0.46 () {54 vars in 967 bytes} [Thu Aug 18 19:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:41.564080 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f301a-4c50-483b-96e1-9dfea4f7fb2b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:41.564372 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f301a-4c50-483b-96e1-9dfea4f7fb2b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:41.564706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f301a-4c50-483b-96e1-9dfea4f7fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:41.584454 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-408f301a-4c50-483b-96e1-9dfea4f7fb2b None None] MFA Rules not processed for user `01123f6512bb4554bf757a1ca0cc46da`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:41.585684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-408f301a-4c50-483b-96e1-9dfea4f7fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:41.592933 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 544/1091] 10.222.0.46 () {58 vars in 1064 bytes} [Thu Aug 18 19:20:41 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:41.601200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f97b9-3e40-4b57-9897-49a6a7737a07 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:41.611969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f97b9-3e40-4b57-9897-49a6a7737a07 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:41.615395 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c8a8-be9f-4c23-a835-c143c6022b96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01123f6512bb4554bf757a1ca0cc46da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:41.616009 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c8a8-be9f-4c23-a835-c143c6022b96 service glance] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:41.616291 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c8a8-be9f-4c23-a835-c143c6022b96 service glance] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:41.616564 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c8a8-be9f-4c23-a835-c143c6022b96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:41.625876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c8a8-be9f-4c23-a835-c143c6022b96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:41.627294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c8a8-be9f-4c23-a835-c143c6022b96 service glance] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:41.636488 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 548/1092] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:20:43.890551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19cb04-3bd2-48f1-ac54-257c6c5f5728 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:43.891067 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19cb04-3bd2-48f1-ac54-257c6c5f5728 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:43.891067 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19cb04-3bd2-48f1-ac54-257c6c5f5728 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:43.892329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 545/1093] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:43.897458 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164172f-02c2-4ed8-a797-23df7c1fdc7b None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:43.897865 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164172f-02c2-4ed8-a797-23df7c1fdc7b None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:43.898011 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164172f-02c2-4ed8-a797-23df7c1fdc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:43.917069 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-a164172f-02c2-4ed8-a797-23df7c1fdc7b None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:43.918250 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-a164172f-02c2-4ed8-a797-23df7c1fdc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:43.925841 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 549/1094] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:44.257095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19cb04-3bd2-48f1-ac54-257c6c5f5728 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:44.269902 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19cb04-3bd2-48f1-ac54-257c6c5f5728 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:44.274316 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:44.274905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:44.275187 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:44.275460 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:44.276095 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:44.277931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:20:44.277931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:20:44.277931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:20:44.279622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcb1ff-808f-47f9-b887-b9ebcea09c0c admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:44.297846 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 546/1095] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 18 19:20:44 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:20:46.500497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f5ad-1d32-48a0-aab9-2fb5128ca57d None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:46.501100 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f5ad-1d32-48a0-aab9-2fb5128ca57d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:46.501285 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f5ad-1d32-48a0-aab9-2fb5128ca57d None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:46.502605 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 550/1096] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:46.507726 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1041-3644-4914-afa6-8ec3c2f76b33 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:46.508160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1041-3644-4914-afa6-8ec3c2f76b33 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:46.508273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1041-3644-4914-afa6-8ec3c2f76b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:46.527634 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-58ee1041-3644-4914-afa6-8ec3c2f76b33 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:46.528862 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-58ee1041-3644-4914-afa6-8ec3c2f76b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:46.537179 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 547/1097] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:46.893982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486f5ad-1d32-48a0-aab9-2fb5128ca57d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:46.908041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486f5ad-1d32-48a0-aab9-2fb5128ca57d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:46.912902 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fee2-79ce-4b91-9691-8fed3869b262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:46.913492 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fee2-79ce-4b91-9691-8fed3869b262 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:46.913797 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fee2-79ce-4b91-9691-8fed3869b262 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:46.914068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fee2-79ce-4b91-9691-8fed3869b262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:46.922595 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fee2-79ce-4b91-9691-8fed3869b262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:46.924156 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fee2-79ce-4b91-9691-8fed3869b262 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:46.933397 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 551/1098] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:49.287393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f16c-c295-434e-9725-76f9c936fe7c None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:49.288024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f16c-c295-434e-9725-76f9c936fe7c None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:49.288024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f16c-c295-434e-9725-76f9c936fe7c None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:49.289369 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 548/1099] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:49.294653 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c34e-9912-48c0-b5dc-837e5a3c1486 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:49.295140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c34e-9912-48c0-b5dc-837e5a3c1486 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:49.295253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c34e-9912-48c0-b5dc-837e5a3c1486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:49.314544 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-4dc8c34e-9912-48c0-b5dc-837e5a3c1486 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:49.315722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-4dc8c34e-9912-48c0-b5dc-837e5a3c1486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:49.323303 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 552/1100] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:49.670931 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f16c-c295-434e-9725-76f9c936fe7c None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:49.681703 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f16c-c295-434e-9725-76f9c936fe7c None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:49.685881 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aecd8a-b9c6-469f-865f-43c5a4ed14e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:49.686471 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aecd8a-b9c6-469f-865f-43c5a4ed14e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:49.686749 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aecd8a-b9c6-469f-865f-43c5a4ed14e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:49.687016 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aecd8a-b9c6-469f-865f-43c5a4ed14e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:49.695884 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aecd8a-b9c6-469f-865f-43c5a4ed14e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:49.697396 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aecd8a-b9c6-469f-865f-43c5a4ed14e0 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:49.706516 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 549/1101] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:51.940083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ac748-c3cf-462c-b8ed-c75ce74117ec None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:51.940637 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ac748-c3cf-462c-b8ed-c75ce74117ec None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:51.940637 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ac748-c3cf-462c-b8ed-c75ce74117ec None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:51.941982 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 553/1102] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:51.947625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d2086-b3d4-4bec-a3c2-2225f07b243d None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:51.948081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d2086-b3d4-4bec-a3c2-2225f07b243d None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:51.948184 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d2086-b3d4-4bec-a3c2-2225f07b243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:51.968155 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-d33d2086-b3d4-4bec-a3c2-2225f07b243d None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:51.969387 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d33d2086-b3d4-4bec-a3c2-2225f07b243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:51.976914 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 550/1103] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:52.318262 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ac748-c3cf-462c-b8ed-c75ce74117ec None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:52.329451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ac748-c3cf-462c-b8ed-c75ce74117ec None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:52.332909 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce2dd0-b340-41ff-b245-5b2638c88da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:52.333506 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2dd0-b340-41ff-b245-5b2638c88da6 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:52.333787 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2dd0-b340-41ff-b245-5b2638c88da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:52.334066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2dd0-b340-41ff-b245-5b2638c88da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:52.342727 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce2dd0-b340-41ff-b245-5b2638c88da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:52.344159 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce2dd0-b340-41ff-b245-5b2638c88da6 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:52.353336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 554/1104] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:54.678989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566353-313a-40f7-b71e-1fdec039caef None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:54.679554 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566353-313a-40f7-b71e-1fdec039caef None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:54.679554 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566353-313a-40f7-b71e-1fdec039caef None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:54.681278 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 551/1105] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:54.686916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a85a-5062-40f5-a54f-bb3ece7cf552 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:54.687375 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a85a-5062-40f5-a54f-bb3ece7cf552 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:54.687490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a85a-5062-40f5-a54f-bb3ece7cf552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:54.707671 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-6941a85a-5062-40f5-a54f-bb3ece7cf552 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:54.708888 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-6941a85a-5062-40f5-a54f-bb3ece7cf552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:54.717067 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 555/1106] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:20:55.061044 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566353-313a-40f7-b71e-1fdec039caef None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:55.071616 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566353-313a-40f7-b71e-1fdec039caef None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:55.075066 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f059b13-50a2-4181-b37f-6eef8837ec85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:55.076223 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f059b13-50a2-4181-b37f-6eef8837ec85 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:55.076503 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f059b13-50a2-4181-b37f-6eef8837ec85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:55.076810 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f059b13-50a2-4181-b37f-6eef8837ec85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:55.085500 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f059b13-50a2-4181-b37f-6eef8837ec85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:55.086929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f059b13-50a2-4181-b37f-6eef8837ec85 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:55.097064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 552/1107] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:20:57.540829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038f5b-a1e2-492c-9bb7-917a28f4fb4a None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:57.541412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038f5b-a1e2-492c-9bb7-917a28f4fb4a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:57.541412 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038f5b-a1e2-492c-9bb7-917a28f4fb4a None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:57.542619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 556/1108] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 18 19:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:20:57.547882 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a9287-80b7-4932-9037-86685fcb66aa None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:57.548299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a9287-80b7-4932-9037-86685fcb66aa None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:57.548433 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a9287-80b7-4932-9037-86685fcb66aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:57.567821 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-c62a9287-80b7-4932-9037-86685fcb66aa None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:20:57.569107 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-c62a9287-80b7-4932-9037-86685fcb66aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:20:57.577250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 553/1109] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 18 19:20:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:20:57.921972 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038f5b-a1e2-492c-9bb7-917a28f4fb4a None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:20:57.932566 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038f5b-a1e2-492c-9bb7-917a28f4fb4a None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:20:57.936776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbf64b-0969-477d-82ca-c7d1f7d12a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:20:57.937365 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf64b-0969-477d-82ca-c7d1f7d12a70 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:20:57.937643 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf64b-0969-477d-82ca-c7d1f7d12a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:20:57.937920 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf64b-0969-477d-82ca-c7d1f7d12a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:20:57.946614 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbf64b-0969-477d-82ca-c7d1f7d12a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:20:57.948027 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbf64b-0969-477d-82ca-c7d1f7d12a70 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:20:57.957850 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 557/1110] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:20:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:21:07.563194 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=33 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:21:07.953701 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=33 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:22:11.612461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718261-f99f-4916-b03f-71e70743e440 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.613079 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718261-f99f-4916-b03f-71e70743e440 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.613079 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718261-f99f-4916-b03f-71e70743e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.631841 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-63718261-f99f-4916-b03f-71e70743e440 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:22:11.640391 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-63718261-f99f-4916-b03f-71e70743e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:11.648294 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 554/1111] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:22:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:22:11.657635 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.658186 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.658603 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.678660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:22:11.679868 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:11.688491 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 558/1112] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:22:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:22:11.692905 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63718261-f99f-4916-b03f-71e70743e440 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:11.703053 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63718261-f99f-4916-b03f-71e70743e440 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:11.707521 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:11.708111 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.708389 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.708661 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.709502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:22:11.709825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:11.712166 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:11.712166 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:22:11.712166 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:22:11.713093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:11.725461 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 555/1113] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 18 19:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:22:11.734105 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:11.743730 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de7eb8-0505-413a-ba42-dc5d568412dc None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:11.748417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:11.749059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.749342 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.749615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.750240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:11.752013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:11.752013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:22:11.752013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:22:11.753281 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:11.782368 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 559/1114] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 18 19:22:11 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:22:11.786720 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:11.798171 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8700a3-fbb5-4a28-8454-462e5ebc4592 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:11.854092 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:11.854660 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.854940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.855213 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.855844 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:11.857125 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:11.857125 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:22:11.857125 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:22:11.858406 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:11.880561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 556/1115] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:22:11 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:22:11.884660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:11.897658 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306580-0776-4801-8378-9c3dc7e9e18f admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:11.902804 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:11.903403 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.903680 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.903951 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.904588 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:11.905627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:11.905627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:22:11.905627 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:22:11.906508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:11.919391 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 560/1116] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:22:11.924055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:11.934215 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c58693-3410-4333-97cf-433d9ff5abc5 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:11.938868 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:11.939463 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.939742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.940019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.940659 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:11.941684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:11.941684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:22:11.941684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:22:11.942565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa9a74-d316-41ed-b36c-07fee30c4efa admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:11.956534 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 557/1117] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:22:11.960764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:11.972874 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaf5e2-4806-48f1-a166-d71a61891ee1 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:11.977484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:11.978142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:11.978425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:11.978707 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] PATH_INFO: `/v3/projects/81872f32c3fe474f9ac57c055a24f27f/users/8b236094b15948b59ce3ccc5da80d63b/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:11.995298 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=81872f32c3fe474f9ac57c055a24f27f, user_id=8b236094b15948b59ce3ccc5da80d63b, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:11.996341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:11.996341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:22:11.996341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:22:11.998340 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac2d5-9f07-4514-88f4-4f1e2322dccc admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:12.012179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 561/1118] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:22:11 2022] PUT /identity/v3/projects/81872f32c3fe474f9ac57c055a24f27f/users/8b236094b15948b59ce3ccc5da80d63b/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:22:12.026077 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd53c8-80f0-49a5-80b3-49d13c99b9a4 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.026360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd53c8-80f0-49a5-80b3-49d13c99b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.026751 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd53c8-80f0-49a5-80b3-49d13c99b9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.054788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-51cd53c8-80f0-49a5-80b3-49d13c99b9a4 None None] MFA Rules not processed for user `8b236094b15948b59ce3ccc5da80d63b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:22:12.055954 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-51cd53c8-80f0-49a5-80b3-49d13c99b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:12.121066 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 558/1119] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:22:12 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:22:12.135861 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c635f8-7a54-48f9-8105-25277457f366 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.136358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c635f8-7a54-48f9-8105-25277457f366 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.136863 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c635f8-7a54-48f9-8105-25277457f366 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.138321 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 562/1120] 10.222.0.46 () {54 vars in 964 bytes} [Thu Aug 18 19:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:22:12.143640 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a508f-abb0-41c1-b1be-f7bef45cf924 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.143957 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a508f-abb0-41c1-b1be-f7bef45cf924 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.144239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a508f-abb0-41c1-b1be-f7bef45cf924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.166237 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-879a508f-abb0-41c1-b1be-f7bef45cf924 None None] MFA Rules not processed for user `c92ff75ad2d142e1951491932002b036`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:22:12.168101 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-879a508f-abb0-41c1-b1be-f7bef45cf924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:12.224510 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:22:12.233102 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 559/1121] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Aug 18 19:22:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:22:12.240817 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c635f8-7a54-48f9-8105-25277457f366 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:12.252110 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c635f8-7a54-48f9-8105-25277457f366 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:12.255611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92ff75ad2d142e1951491932002b036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:12.256245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.256508 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.256806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.265576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:12.267089 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:12.276090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 563/1122] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:22:12 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:22:12.313274 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8cceb-61aa-4201-9030-151ae78d9201 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.313561 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8cceb-61aa-4201-9030-151ae78d9201 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.313834 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8cceb-61aa-4201-9030-151ae78d9201 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.315081 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 560/1123] 10.222.0.46 () {52 vars in 830 bytes} [Thu Aug 18 19:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:22:12.318800 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:12.378926 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3752-0201-499d-8602-a7f8e1419e4d service cinder] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:12.383376 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:12.383999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.384284 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.384563 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] PATH_INFO: `/v3/users/8b236094b15948b59ce3ccc5da80d63b` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.385717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b236094b15948b59ce3ccc5da80d63b)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:12.387279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:12.387279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:22:12.387279 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:22:12.388487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:12.454449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b236094b15948b59ce3ccc5da80d63b'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:12.476575 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b236094b15948b59ce3ccc5da80d63b'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:12.490696 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b236094b15948b59ce3ccc5da80d63b'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:12.491496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b236094b15948b59ce3ccc5da80d63b'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:12.501393 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b236094b15948b59ce3ccc5da80d63b'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:12.507238 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 564/1124] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 18 19:22:12 2022] DELETE /identity/v3/users/8b236094b15948b59ce3ccc5da80d63b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:22:12.511623 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.511914 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.512191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.532281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:22:12.533549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:12.592612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 561/1125] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:22:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:22:12.602288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:12.603681 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:12.609327 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:22:12.665425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aef60-f8de-4834-8a57-6ba2962542f4 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:12.669670 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4d503-e1fc-4e8b-803f-d62bc79ff446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:12.670274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4d503-e1fc-4e8b-803f-d62bc79ff446 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:12.670554 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4d503-e1fc-4e8b-803f-d62bc79ff446 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:12.670826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4d503-e1fc-4e8b-803f-d62bc79ff446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:12.679771 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4d503-e1fc-4e8b-803f-d62bc79ff446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:12.681266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4d503-e1fc-4e8b-803f-d62bc79ff446 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:12.691088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 565/1126] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:22:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:22:13.151131 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:22:13.153120 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:22:13.165309 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a6f8a-dd7c-41e5-ae03-deeb92dbbf37 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:22:13.170485 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:22:13.171136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:22:13.171414 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:22:13.171685 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] PATH_INFO: `/v3/projects/81872f32c3fe474f9ac57c055a24f27f` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:22:13.172828 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81872f32c3fe474f9ac57c055a24f27f)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:22:13.173840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:22:13.173840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:22:13.173840 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:22:13.175129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:22:13.240502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81872f32c3fe474f9ac57c055a24f27f', 'request_id': 'req-81583fcb-2975-4f8d-a293-db44887ae560'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:13.246495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81872f32c3fe474f9ac57c055a24f27f', 'request_id': 'req-81583fcb-2975-4f8d-a293-db44887ae560'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:13.256070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81872f32c3fe474f9ac57c055a24f27f', 'request_id': 'req-81583fcb-2975-4f8d-a293-db44887ae560'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:13.274948 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] The token cache is being invalidate because project 81872f32c3fe474f9ac57c055a24f27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:22:13.275234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:13.275962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-81583fcb-2975-4f8d-a293-db44887ae560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:22:13.278029 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 562/1127] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 18 19:22:13 2022] DELETE /identity/v3/projects/81872f32c3fe474f9ac57c055a24f27f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:22:22.687059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=25 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:22:23.271959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:23:32.976780 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700fa9-0a84-4fb6-8717-59938b5d6241 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:32.977358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700fa9-0a84-4fb6-8717-59938b5d6241 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:32.977358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700fa9-0a84-4fb6-8717-59938b5d6241 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:32.978574 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:32.983759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041768e8-b669-4302-9a01-4e81cc990fd2 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:32.984170 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041768e8-b669-4302-9a01-4e81cc990fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:32.984313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041768e8-b669-4302-9a01-4e81cc990fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:33.052148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-041768e8-b669-4302-9a01-4e81cc990fd2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:33.053402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-041768e8-b669-4302-9a01-4e81cc990fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:33.157891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:23:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:33.317127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700fa9-0a84-4fb6-8717-59938b5d6241 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:33.318896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-c7700fa9-0a84-4fb6-8717-59938b5d6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:33.403937 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700fa9-0a84-4fb6-8717-59938b5d6241 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:33.409384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c22adb-187b-4602-ad03-a8bcbac5a927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:33.409983 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c22adb-187b-4602-ad03-a8bcbac5a927 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:33.410267 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c22adb-187b-4602-ad03-a8bcbac5a927 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:33.410542 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c22adb-187b-4602-ad03-a8bcbac5a927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:33.418417 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c22adb-187b-4602-ad03-a8bcbac5a927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:33.419995 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c22adb-187b-4602-ad03-a8bcbac5a927 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:33.429733 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 567/1130] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:34.265086 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3567-aa74-43e7-9a20-7f2b8343e2ac None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:34.265687 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3567-aa74-43e7-9a20-7f2b8343e2ac None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:34.265687 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3567-aa74-43e7-9a20-7f2b8343e2ac None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:34.267596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:34.272490 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fef4-c1bf-47a5-a3b3-945079734f27 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:34.272916 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fef4-c1bf-47a5-a3b3-945079734f27 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:34.273083 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fef4-c1bf-47a5-a3b3-945079734f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:34.292088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-9f08fef4-c1bf-47a5-a3b3-945079734f27 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:34.293292 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-9f08fef4-c1bf-47a5-a3b3-945079734f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:34.300838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:23:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:34.455332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd3567-aa74-43e7-9a20-7f2b8343e2ac None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:34.468423 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd3567-aa74-43e7-9a20-7f2b8343e2ac None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:34.474146 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd09d-ca31-40c1-ac02-1bf01dc1c454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:34.474736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd09d-ca31-40c1-ac02-1bf01dc1c454 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:34.475010 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd09d-ca31-40c1-ac02-1bf01dc1c454 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:34.475283 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd09d-ca31-40c1-ac02-1bf01dc1c454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:34.483469 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd09d-ca31-40c1-ac02-1bf01dc1c454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:34.485130 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd09d-ca31-40c1-ac02-1bf01dc1c454 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:34.495117 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 565/1133] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:38.612985 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9c9b-0d0a-4b54-8b31-40b067125adb None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:38.613488 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9c9b-0d0a-4b54-8b31-40b067125adb None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:38.613589 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9c9b-0d0a-4b54-8b31-40b067125adb None None] PATH_INFO: `/v3` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:38.614777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 569/1134] 10.222.0.59 () {54 vars in 925 bytes} [Thu Aug 18 19:23:38 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:23:38.620828 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585fda-3bec-440b-8b29-06fe715e1c53 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:38.621273 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585fda-3bec-440b-8b29-06fe715e1c53 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:38.621375 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585fda-3bec-440b-8b29-06fe715e1c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:38.650178 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-4d585fda-3bec-440b-8b29-06fe715e1c53 None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:38.651379 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-4d585fda-3bec-440b-8b29-06fe715e1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:38.706632 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:23:38.716142 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 566/1135] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Aug 18 19:23:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:23:42.822079 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cbaf1-d098-4a7c-9f3f-b33e4624676f None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:42.822644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cbaf1-d098-4a7c-9f3f-b33e4624676f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:42.822644 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cbaf1-d098-4a7c-9f3f-b33e4624676f None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:42.823917 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 570/1136] 10.222.0.46 () {54 vars in 961 bytes} [Thu Aug 18 19:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:42.828856 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d6d8-785e-4be0-9592-f7acedcdd1ac None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:42.829291 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d6d8-785e-4be0-9592-f7acedcdd1ac None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:42.829407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d6d8-785e-4be0-9592-f7acedcdd1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:42.849182 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-6895d6d8-785e-4be0-9592-f7acedcdd1ac None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:42.850417 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-6895d6d8-785e-4be0-9592-f7acedcdd1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:42.859069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 567/1137] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Aug 18 19:23:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:23:42.866363 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cbaf1-d098-4a7c-9f3f-b33e4624676f None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:42.879918 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cbaf1-d098-4a7c-9f3f-b33e4624676f None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:42.884771 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314630-01bc-449f-ad05-045b2aa58d48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:42.885356 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314630-01bc-449f-ad05-045b2aa58d48 service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:42.885636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314630-01bc-449f-ad05-045b2aa58d48 service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:42.885909 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314630-01bc-449f-ad05-045b2aa58d48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:42.894601 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314630-01bc-449f-ad05-045b2aa58d48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:42.896171 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314630-01bc-449f-ad05-045b2aa58d48 service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:42.905942 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 571/1138] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:45.736394 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa11b82-2751-43f7-b2ca-7e822b99506f None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:45.737000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa11b82-2751-43f7-b2ca-7e822b99506f None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:45.737000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa11b82-2751-43f7-b2ca-7e822b99506f None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:45.738275 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:45.742964 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d857993-b235-4549-926a-a341f8464cab None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:45.743383 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d857993-b235-4549-926a-a341f8464cab None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:45.743496 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d857993-b235-4549-926a-a341f8464cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:45.763039 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-8d857993-b235-4549-926a-a341f8464cab None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:45.764240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-8d857993-b235-4549-926a-a341f8464cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:45.772976 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:23:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:45.930183 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa11b82-2751-43f7-b2ca-7e822b99506f None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:45.944390 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa11b82-2751-43f7-b2ca-7e822b99506f None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:45.949488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164522b-bd9f-40ac-885d-8152dfd8681d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:45.950084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164522b-bd9f-40ac-885d-8152dfd8681d service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:45.950367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164522b-bd9f-40ac-885d-8152dfd8681d service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:45.950645 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164522b-bd9f-40ac-885d-8152dfd8681d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:45.959360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164522b-bd9f-40ac-885d-8152dfd8681d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:45.960975 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164522b-bd9f-40ac-885d-8152dfd8681d service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:45.971340 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 569/1141] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:46.814705 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab5318-b4e5-407a-9cdb-7815c0ecb35a None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:46.815270 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab5318-b4e5-407a-9cdb-7815c0ecb35a None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:46.815270 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab5318-b4e5-407a-9cdb-7815c0ecb35a None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:46.816583 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:46.821259 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad23eef-587c-4030-a415-df95751ce3ac None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:46.821721 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad23eef-587c-4030-a415-df95751ce3ac None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:46.821830 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad23eef-587c-4030-a415-df95751ce3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:46.841421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-4ad23eef-587c-4030-a415-df95751ce3ac None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:46.842528 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-4ad23eef-587c-4030-a415-df95751ce3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:46.850904 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:23:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:47.011484 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab5318-b4e5-407a-9cdb-7815c0ecb35a None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:47.025358 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab5318-b4e5-407a-9cdb-7815c0ecb35a None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:47.030938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c6955-14bd-4bcd-ba90-0b9f6668dc10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:47.031562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6955-14bd-4bcd-ba90-0b9f6668dc10 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:47.031899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6955-14bd-4bcd-ba90-0b9f6668dc10 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:47.032238 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6955-14bd-4bcd-ba90-0b9f6668dc10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:47.050426 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6955-14bd-4bcd-ba90-0b9f6668dc10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:47.052058 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6955-14bd-4bcd-ba90-0b9f6668dc10 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:47.063433 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 574/1144] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:51.238863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8149-bc86-42cf-a785-8dff520c2766 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:51.239407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8149-bc86-42cf-a785-8dff520c2766 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:51.239407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8149-bc86-42cf-a785-8dff520c2766 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:51.240802 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:51.246160 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987dcd-2319-41a8-b0db-c9e4044f19ce None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:51.246589 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987dcd-2319-41a8-b0db-c9e4044f19ce None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:51.246709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987dcd-2319-41a8-b0db-c9e4044f19ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:51.266253 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-5a987dcd-2319-41a8-b0db-c9e4044f19ce None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:51.268073 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-5a987dcd-2319-41a8-b0db-c9e4044f19ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:51.275876 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:23:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:51.618270 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8149-bc86-42cf-a785-8dff520c2766 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:51.619976 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-24dc8149-bc86-42cf-a785-8dff520c2766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:51.677543 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8149-bc86-42cf-a785-8dff520c2766 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:51.681653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2d4e-091d-42fb-a770-85c0ab50293a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:51.682256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2d4e-091d-42fb-a770-85c0ab50293a service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:51.682538 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2d4e-091d-42fb-a770-85c0ab50293a service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:51.682813 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2d4e-091d-42fb-a770-85c0ab50293a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:51.691587 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf2d4e-091d-42fb-a770-85c0ab50293a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:51.693064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf2d4e-091d-42fb-a770-85c0ab50293a service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:51.702285 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 572/1147] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:53.856991 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484838f-5fa5-457f-9e4a-7e23f4bff37d None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:53.857823 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484838f-5fa5-457f-9e4a-7e23f4bff37d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:53.857823 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484838f-5fa5-457f-9e4a-7e23f4bff37d None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:53.859031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:53.864652 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa3b9-ef31-40e3-a7d2-8d2cbc02b37a None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:53.865098 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa3b9-ef31-40e3-a7d2-8d2cbc02b37a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:53.865227 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa3b9-ef31-40e3-a7d2-8d2cbc02b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:53.884884 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-e46aa3b9-ef31-40e3-a7d2-8d2cbc02b37a None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:53.886072 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-e46aa3b9-ef31-40e3-a7d2-8d2cbc02b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:53.893995 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:23:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:54.241473 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484838f-5fa5-457f-9e4a-7e23f4bff37d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:54.252179 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484838f-5fa5-457f-9e4a-7e23f4bff37d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:54.255619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae65d52-d04d-4a45-a2a4-c5965bdb7ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:54.256210 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae65d52-d04d-4a45-a2a4-c5965bdb7ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:54.256485 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae65d52-d04d-4a45-a2a4-c5965bdb7ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:54.256782 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae65d52-d04d-4a45-a2a4-c5965bdb7ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:54.265442 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae65d52-d04d-4a45-a2a4-c5965bdb7ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:54.266949 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae65d52-d04d-4a45-a2a4-c5965bdb7ea1 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:54.276495 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 577/1150] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:23:58.190598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4342-396f-4ca6-bf60-fb7c44ba8761 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:58.191173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4342-396f-4ca6-bf60-fb7c44ba8761 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:58.191173 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4342-396f-4ca6-bf60-fb7c44ba8761 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:58.192472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:23:58.197606 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b967a55-2a5f-4017-94d6-fb44abf2a7d3 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:58.198140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b967a55-2a5f-4017-94d6-fb44abf2a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:58.198140 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b967a55-2a5f-4017-94d6-fb44abf2a7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:58.217530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-9b967a55-2a5f-4017-94d6-fb44abf2a7d3 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:23:58.218710 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-9b967a55-2a5f-4017-94d6-fb44abf2a7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:58.227409 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:23:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:23:58.801003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4342-396f-4ca6-bf60-fb7c44ba8761 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:23:58.802658 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-ddcb4342-396f-4ca6-bf60-fb7c44ba8761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:23:58.866603 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4342-396f-4ca6-bf60-fb7c44ba8761 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:23:58.870008 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dafdcc-7108-4f80-bda3-3401a7115199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92ff75ad2d142e1951491932002b036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:23:58.870620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafdcc-7108-4f80-bda3-3401a7115199 service cinder] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:23:58.871207 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafdcc-7108-4f80-bda3-3401a7115199 service cinder] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:23:58.871305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafdcc-7108-4f80-bda3-3401a7115199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:23:58.881641 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafdcc-7108-4f80-bda3-3401a7115199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:23:58.883249 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafdcc-7108-4f80-bda3-3401a7115199 service cinder] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:23:58.893267 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 575/1153] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:23:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:24:01.105305 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1277bc-863f-4518-8972-edeaaf72944f None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:24:01.105958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1277bc-863f-4518-8972-edeaaf72944f None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:24:01.105958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1277bc-863f-4518-8972-edeaaf72944f None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:24:01.107225 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:24:01.113055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22949e6-9b43-43ff-97c4-de48075a7aa5 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:24:01.113516 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22949e6-9b43-43ff-97c4-de48075a7aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:24:01.113614 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22949e6-9b43-43ff-97c4-de48075a7aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:24:01.132729 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-e22949e6-9b43-43ff-97c4-de48075a7aa5 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:24:01.133935 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-e22949e6-9b43-43ff-97c4-de48075a7aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:24:01.141815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:24:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:24:01.710959 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1277bc-863f-4518-8972-edeaaf72944f None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:24:01.712604 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-ad1277bc-863f-4518-8972-edeaaf72944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:24:01.725418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1277bc-863f-4518-8972-edeaaf72944f None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:24:01.728838 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb766f-4e5a-41bd-a498-a552da34a6d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92ff75ad2d142e1951491932002b036', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:24:01.729423 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb766f-4e5a-41bd-a498-a552da34a6d7 service cinder] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:24:01.729699 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb766f-4e5a-41bd-a498-a552da34a6d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:24:01.729966 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb766f-4e5a-41bd-a498-a552da34a6d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:24:01.738940 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb766f-4e5a-41bd-a498-a552da34a6d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:24:01.740352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb766f-4e5a-41bd-a498-a552da34a6d7 service cinder] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:24:01.749646 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 580/1156] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:24:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:24:11.127892 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=70 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:24:11.745512 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=75 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:15.278676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a9ff-5771-4b08-bfb8-09a40bb64e64 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.279311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a9ff-5771-4b08-bfb8-09a40bb64e64 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.279311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a9ff-5771-4b08-bfb8-09a40bb64e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.298594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-72e5a9ff-5771-4b08-bfb8-09a40bb64e64 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:15.299805 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-72e5a9ff-5771-4b08-bfb8-09a40bb64e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:15.306970 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07cee5-0059-45c6-978a-02028dfbbc75 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.307486 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07cee5-0059-45c6-978a-02028dfbbc75 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.307586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07cee5-0059-45c6-978a-02028dfbbc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.308064 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 577/1157] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:15.315958 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.316244 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.317166 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.327425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-3a07cee5-0059-45c6-978a-02028dfbbc75 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:15.328576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-3a07cee5-0059-45c6-978a-02028dfbbc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:15.335684 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:15.336860 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:15.336992 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 581/1158] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:15.344395 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 578/1159] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:15.347892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.347892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.347892 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.349209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.358305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da17493-ea98-4604-a16a-244a261382e2 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.363036 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.364156 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.364433 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.364724 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.365360 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:25:15.365521 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:15.365656 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.366702 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:15.367218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.374407 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 582/1160] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:15.378968 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.380093 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 579/1161] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:25:15.387938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.388341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318784e4-ad3e-4122-8e6b-bd87cad83792 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.392864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.393460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.393741 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.394018 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] PATH_INFO: `/v3/domains` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.394700 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:25:15.395123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.396143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:25:15.396143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:25:15.396143 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:25:15.397084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.397717 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59241dc2-46ab-4955-a175-8a9bc62d6bc2 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.402488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.403089 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.403428 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.403707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.404324 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.405374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:25:15.405374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:25:15.405374 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:25:15.406759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.409014 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 583/1162] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:25:15.416939 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.427200 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2f2a2-bb20-442b-8c9d-3bf54d4e5149 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.431866 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.432472 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.432781 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.433055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.433745 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.435652 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.450032 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 580/1163] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:25:15.451185 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.465487 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 584/1164] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:25:15.469744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.515716 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba389a-c0f4-4ede-b22a-71d86c7e6d06 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.534667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e07aa-7f25-41c1-b5ce-962efd860be5 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.540016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.540620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.540936 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.541206 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.541819 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.542833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:25:15.542833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:25:15.542833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:25:15.544048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.564901 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 585/1165] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:25:15.568839 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.572474 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.573210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.573625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.573933 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.574553 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.576502 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.578101 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d1bfb-a22f-493d-91a9-803cfc2f1976 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.582805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.583403 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.583683 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.583955 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.584632 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.586260 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.597459 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 586/1166] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:25:15.601762 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.607327 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 581/1167] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:25:15.608622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.611922 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8948fb-d663-4b21-af8c-5e991c5dd2b4 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.617258 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.617856 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.618136 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.618414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.618891 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504250-dea0-42ad-b9f5-54b467c74874 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.619046 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.620652 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.623612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.624246 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.624558 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.624995 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.625639 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.627256 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.630615 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 587/1168] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 19:25:15.634743 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.640219 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 582/1169] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:25:15.641189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.644228 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f405-4ed5-45f2-a3bc-619bff68aa80 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.648873 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ece7e-084d-4018-9dbb-fdb9950b68e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.649514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ece7e-084d-4018-9dbb-fdb9950b68e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.649795 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ece7e-084d-4018-9dbb-fdb9950b68e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.650084 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ece7e-084d-4018-9dbb-fdb9950b68e7 admin admin] PATH_INFO: `/v3/projects/289f5aca1490482d879439ef3e708487/users/b8738a31d47c42b8a01889fcaa9d1fb6/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.650697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed74602-0366-4ea1-a22b-a0b10b9b1fd6 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.655518 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.656114 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.656407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.656699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.657366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.658953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.665692 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ece7e-084d-4018-9dbb-fdb9950b68e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289f5aca1490482d879439ef3e708487, user_id=b8738a31d47c42b8a01889fcaa9d1fb6, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.668341 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ece7e-084d-4018-9dbb-fdb9950b68e7 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.672519 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 583/1170] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 19:25:15.675736 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.682921 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 588/1171] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:25:15 2022] PUT /identity/v3/projects/289f5aca1490482d879439ef3e708487/users/b8738a31d47c42b8a01889fcaa9d1fb6/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:25:15.686578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27f27-334c-460c-9cfc-bac6e2314b42 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.687820 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.688124 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.688401 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.698877 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:15.709608 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:15.710818 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:15.744962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.745716 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.746000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.746278 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] PATH_INFO: `/v3/projects/64fd18da9563416ea77e6d354eb1a431/users/f41d113f35574f50997dbcf25fe39f83/roles/99603dce58184be6bdfb41cb63477e74` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.758240 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:15.763453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fd18da9563416ea77e6d354eb1a431, user_id=f41d113f35574f50997dbcf25fe39f83, role_id=99603dce58184be6bdfb41cb63477e74)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.764475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:25:15.764475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:25:15.764475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:25:15.766571 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749e9f9-7d9d-44b5-9901-7363b21dcc35 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.771765 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 589/1172] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:15.780549 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 584/1173] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:25:15 2022] PUT /identity/v3/projects/64fd18da9563416ea77e6d354eb1a431/users/f41d113f35574f50997dbcf25fe39f83/roles/99603dce58184be6bdfb41cb63477e74 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:25:15.783514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.786136 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.786370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.786649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.805699 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] MFA Rules not processed for user `661b53358e904910bb42d525c798f725`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:15.806926 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:15.842273 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fe5b-2553-4463-a369-bdabe9c370c6 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.866434 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 585/1174] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:15.876505 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:15.894334 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173708e3-f862-40c6-809c-145edac86fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.895489 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173708e3-f862-40c6-809c-145edac86fed service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.895810 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173708e3-f862-40c6-809c-145edac86fed service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.896109 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173708e3-f862-40c6-809c-145edac86fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.905385 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173708e3-f862-40c6-809c-145edac86fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.906872 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173708e3-f862-40c6-809c-145edac86fed service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.916967 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 590/1175] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:15.932015 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08600758-524b-417d-a9a2-dc8989f94718 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:15.935589 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de65fc-f677-46f8-86cb-26321ee0c655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:15.936370 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de65fc-f677-46f8-86cb-26321ee0c655 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:15.936809 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de65fc-f677-46f8-86cb-26321ee0c655 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:15.937083 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de65fc-f677-46f8-86cb-26321ee0c655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:15.946457 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de65fc-f677-46f8-86cb-26321ee0c655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:15.947883 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de65fc-f677-46f8-86cb-26321ee0c655 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:15.957981 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 586/1176] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:25:21.469923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:21.470468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:21.470468 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:21.521415 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:21.522836 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:21.610817 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:21.611402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:21.611402 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:21.650611 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 591/1177] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:21 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:21.653439 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] MFA Rules not processed for user `b8738a31d47c42b8a01889fcaa9d1fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:21.654953 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:21.655875 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:21.669275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a066b54-0f4e-4b37-b321-aaa0942d0215 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:21.675402 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:21.676366 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:21.676912 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:21.677374 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:21.678219 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:21.680772 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:21.693788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:21.725560 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 592/1178] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 18 19:25:21 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:25:21.729020 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:21.753068 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 587/1179] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:21 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:21.761296 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:21.775987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:21.788311 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979545d1-55ae-4639-ab4d-c7b3bde1f6fd None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:21.826247 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3537-4b8d-4143-a146-61a2c003ce6c admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:21.833740 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:21.834633 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:21.835062 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:21.835632 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:21.836930 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:21.839961 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:21.861058 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:21.862069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:21.862434 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:21.863003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:21.863825 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:21.866175 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:21.867454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 593/1180] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:25:21 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:25:21.871431 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:21.882275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e59b9-b8d4-4e68-93f2-922fa281a3d7 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:21.888744 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:21.889310 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:21.889600 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:21.890100 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:21.890691 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:21.892584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:21.904954 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 594/1181] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 19:25:21.909333 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:21.913334 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 588/1182] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 18 19:25:21 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:25:21.914838 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:21.923480 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9c84-5199-40a8-82cf-c379d612f95a admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:21.993959 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d44b1-fbb0-419e-a4ee-327d3a9769e1 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:21.999567 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:21.999771 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.000041 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.000318 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] PATH_INFO: `/v3/users` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.000994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.002133 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.003026 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.003239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.003449 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.003798 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] PATH_INFO: `/v3/projects/5d17ba38eae64b1c8c217b37c1a67997/users/cd7dbe8ef0e246eb8ba3140b09878270/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.023981 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d17ba38eae64b1c8c217b37c1a67997, user_id=cd7dbe8ef0e246eb8ba3140b09878270, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.028525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.039513 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 589/1183] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 18 19:25:21 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:25:22.040714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:22.051973 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 595/1184] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:25:21 2022] PUT /identity/v3/projects/5d17ba38eae64b1c8c217b37c1a67997/users/cd7dbe8ef0e246eb8ba3140b09878270/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:25:22.056288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:22.058123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c617b3-63d2-435e-9abb-aa093cfe7a95 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:22.118594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:22.132430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.133074 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.133355 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.133633 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.134281 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.135878 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.148823 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 590/1185] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:25:22.151314 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:22.155514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbec3-f58d-4463-af58-afb0915582ff admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:22.163670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6fb82-afba-4bcc-a6be-6b813a75b903 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:22.167123 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.167757 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.168041 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.168318 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] PATH_INFO: `/v3/roles` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.169038 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.170707 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.171164 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.171929 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.172250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.172488 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] PATH_INFO: `/v3/projects/bdcacc11ff064a84ab2701fcb4b4ce5b/users/216d669d321e46ec939869d6e07f616f/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.182791 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 596/1186] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:25:22.186726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:22.189598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcacc11ff064a84ab2701fcb4b4ce5b, user_id=216d669d321e46ec939869d6e07f616f, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.192302 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.197268 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b060b-f5c6-4b9b-97e8-3973fbe5759b admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:22.202830 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.203514 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.203802 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.204090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] PATH_INFO: `/v3/projects/5d17ba38eae64b1c8c217b37c1a67997/users/cd7dbe8ef0e246eb8ba3140b09878270/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.206638 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d17ba38eae64b1c8c217b37c1a67997, user_id=cd7dbe8ef0e246eb8ba3140b09878270, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.210016 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.212002 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 591/1187] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:25:22 2022] PUT /identity/v3/projects/bdcacc11ff064a84ab2701fcb4b4ce5b/users/216d669d321e46ec939869d6e07f616f/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:25:22.213190 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:22.223853 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 597/1188] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:25:22 2022] PUT /identity/v3/projects/5d17ba38eae64b1c8c217b37c1a67997/users/cd7dbe8ef0e246eb8ba3140b09878270/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:25:22.280467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22dab-27b9-4458-b1fc-48c5677daa31 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:22.357329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db9d1-6fb1-41c1-99b9-c7f11301bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.358240 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db9d1-6fb1-41c1-99b9-c7f11301bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.358962 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db9d1-6fb1-41c1-99b9-c7f11301bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.359438 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db9d1-6fb1-41c1-99b9-c7f11301bd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.360174 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9db9d1-6fb1-41c1-99b9-c7f11301bd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.362495 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9db9d1-6fb1-41c1-99b9-c7f11301bd87 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.375637 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 592/1189] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 18 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:25:22.380722 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:22.414425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c94f5-4da8-4090-8cd5-7c99260918a9 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:22.421509 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe92a5-4337-462f-9b0c-1917d8c6f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:22.423013 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe92a5-4337-462f-9b0c-1917d8c6f035 admin admin] REQUEST_METHOD: `PUT` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:22.424019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe92a5-4337-462f-9b0c-1917d8c6f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:22.424578 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe92a5-4337-462f-9b0c-1917d8c6f035 admin admin] PATH_INFO: `/v3/projects/bdcacc11ff064a84ab2701fcb4b4ce5b/users/216d669d321e46ec939869d6e07f616f/roles/c016aacdd65d4e0287a9d1177e7a0e5c` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:22.428711 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe92a5-4337-462f-9b0c-1917d8c6f035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcacc11ff064a84ab2701fcb4b4ce5b, user_id=216d669d321e46ec939869d6e07f616f, role_id=c016aacdd65d4e0287a9d1177e7a0e5c)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:22.432121 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe92a5-4337-462f-9b0c-1917d8c6f035 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:22.445026 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:22.460742 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 598/1190] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 18 19:25:22 2022] PUT /identity/v3/projects/bdcacc11ff064a84ab2701fcb4b4ce5b/users/216d669d321e46ec939869d6e07f616f/roles/c016aacdd65d4e0287a9d1177e7a0e5c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:25:28.481163 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:28.481731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:28.481731 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:28.528447 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] MFA Rules not processed for user `cd7dbe8ef0e246eb8ba3140b09878270`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:28.531038 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:28.564106 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:28.564636 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:28.564923 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:28.626778 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] MFA Rules not processed for user `216d669d321e46ec939869d6e07f616f`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:28.629546 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:28.638754 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:28.687152 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 593/1191] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:28 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:28.702167 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:28.703474 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:28.812110 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 599/1192] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:28 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:28.826168 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:28.829157 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:28.875861 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2739c-6602-4323-9102-3ffff8e4f10b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:28.880052 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1d33-7074-45bf-bc0e-0fd19bcbe8ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01123f6512bb4554bf757a1ca0cc46da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:28.880920 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1d33-7074-45bf-bc0e-0fd19bcbe8ff service glance] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:28.881207 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1d33-7074-45bf-bc0e-0fd19bcbe8ff service glance] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:28.881482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1d33-7074-45bf-bc0e-0fd19bcbe8ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:28.961971 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cd9db-3a90-433b-a74b-769e7507aff7 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:28.967251 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cac62-03f6-4dc2-83ac-23a1c1b57c89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01123f6512bb4554bf757a1ca0cc46da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:28.967883 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cac62-03f6-4dc2-83ac-23a1c1b57c89 service glance] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:28.968248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cac62-03f6-4dc2-83ac-23a1c1b57c89 service glance] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:28.968525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cac62-03f6-4dc2-83ac-23a1c1b57c89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:28.996539 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a1d33-7074-45bf-bc0e-0fd19bcbe8ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:28.998492 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a1d33-7074-45bf-bc0e-0fd19bcbe8ff service glance] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:29.010540 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 594/1193] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:28 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:25:29.042161 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cac62-03f6-4dc2-83ac-23a1c1b57c89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:29.043953 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cac62-03f6-4dc2-83ac-23a1c1b57c89 service glance] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:29.059550 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 600/1194] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:28 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:37.472710 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae005-f13f-49be-9435-86a8a19a5908 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:37.473299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae005-f13f-49be-9435-86a8a19a5908 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:37.473299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae005-f13f-49be-9435-86a8a19a5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:37.492805 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7fbae005-f13f-49be-9435-86a8a19a5908 None None] MFA Rules not processed for user `b8738a31d47c42b8a01889fcaa9d1fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:37.494019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7fbae005-f13f-49be-9435-86a8a19a5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:37.501082 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 595/1195] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:25:37 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:37.798647 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126daf-6547-41f6-b4a0-96492afe971d None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:37.799233 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126daf-6547-41f6-b4a0-96492afe971d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:37.799364 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126daf-6547-41f6-b4a0-96492afe971d None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:37.801530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 601/1196] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 18 19:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:25:37.807235 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb348-6b6a-420a-b521-c5386a69bb72 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:37.807541 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb348-6b6a-420a-b521-c5386a69bb72 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:37.807815 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb348-6b6a-420a-b521-c5386a69bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:37.839189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-45deb348-6b6a-420a-b521-c5386a69bb72 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:37.840430 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-45deb348-6b6a-420a-b521-c5386a69bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:37.909913 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 596/1197] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 18 19:25:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:37.915555 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bee1-8cd6-4049-8b0d-88622220134d None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:37.915844 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bee1-8cd6-4049-8b0d-88622220134d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:37.916119 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bee1-8cd6-4049-8b0d-88622220134d None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:37.917439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 602/1198] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 18 19:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:25:37.922565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175046fa-cf73-48a2-abd6-0b0e9f43f4f6 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:37.924003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175046fa-cf73-48a2-abd6-0b0e9f43f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:37.924003 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175046fa-cf73-48a2-abd6-0b0e9f43f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:37.944000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-175046fa-cf73-48a2-abd6-0b0e9f43f4f6 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:37.945234 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-175046fa-cf73-48a2-abd6-0b0e9f43f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:37.954245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 597/1199] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 18 19:25:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:37.968767 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bee1-8cd6-4049-8b0d-88622220134d None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:37.980060 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bee1-8cd6-4049-8b0d-88622220134d None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:37.984659 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477168-7266-4681-99a9-5d5cfbbb251b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01123f6512bb4554bf757a1ca0cc46da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:37.985294 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477168-7266-4681-99a9-5d5cfbbb251b service glance] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:37.985576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477168-7266-4681-99a9-5d5cfbbb251b service glance] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:37.985854 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477168-7266-4681-99a9-5d5cfbbb251b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:37.997879 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477168-7266-4681-99a9-5d5cfbbb251b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:37.999608 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477168-7266-4681-99a9-5d5cfbbb251b service glance] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:38.014394 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 603/1200] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:38.502565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b85c1-2590-453d-910e-1907d5b84c93 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:38.503134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b85c1-2590-453d-910e-1907d5b84c93 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:38.503134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b85c1-2590-453d-910e-1907d5b84c93 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:38.504346 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 598/1201] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 18 19:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:25:38.509446 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7588f0-4493-4d56-995e-e15ed6653d9d None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:38.509805 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7588f0-4493-4d56-995e-e15ed6653d9d None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:38.510151 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7588f0-4493-4d56-995e-e15ed6653d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:38.543612 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-1a7588f0-4493-4d56-995e-e15ed6653d9d None None] MFA Rules not processed for user `d18820ebfa644e8585f64355e8bf0f71`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:38.544860 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-1a7588f0-4493-4d56-995e-e15ed6653d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:38.549288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:38.605507 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 604/1202] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 18 19:25:38 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:38.617189 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b85c1-2590-453d-910e-1907d5b84c93 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:38.618991 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-ee7b85c1-2590-453d-910e-1907d5b84c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:38.627755 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=100 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:25:38.633200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b85c1-2590-453d-910e-1907d5b84c93 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:38.636745 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440e04a-d63a-47e2-8703-f3d34f94168f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:38.637342 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440e04a-d63a-47e2-8703-f3d34f94168f service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:38.637630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440e04a-d63a-47e2-8703-f3d34f94168f service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:38.637900 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440e04a-d63a-47e2-8703-f3d34f94168f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:38.645645 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440e04a-d63a-47e2-8703-f3d34f94168f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:38.647280 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440e04a-d63a-47e2-8703-f3d34f94168f service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:38.655498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 599/1203] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:38 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:39.065261 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11e4e7-395e-4431-880e-ebcd22804358 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:39.067009 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11e4e7-395e-4431-880e-ebcd22804358 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:39.067288 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11e4e7-395e-4431-880e-ebcd22804358 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:39.069035 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 605/1204] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 18 19:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:25:39.074435 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec1cf-2468-4855-8032-98d72b7e08ea None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:39.074831 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec1cf-2468-4855-8032-98d72b7e08ea None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:39.075001 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec1cf-2468-4855-8032-98d72b7e08ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:39.091845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11e4e7-395e-4431-880e-ebcd22804358 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:39.106992 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-279ec1cf-2468-4855-8032-98d72b7e08ea None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:39.108453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-279ec1cf-2468-4855-8032-98d72b7e08ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:39.122214 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 600/1205] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 18 19:25:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:39.127918 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f1de-0488-4a4b-9cc6-5e00e4cf5625 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:39.128829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f1de-0488-4a4b-9cc6-5e00e4cf5625 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:39.129187 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f1de-0488-4a4b-9cc6-5e00e4cf5625 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:39.130706 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 601/1206] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 18 19:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:25:39.135788 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399934-7594-4234-a810-08355d3571d9 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:39.136116 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399934-7594-4234-a810-08355d3571d9 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:39.136367 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399934-7594-4234-a810-08355d3571d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:39.158556 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-94399934-7594-4234-a810-08355d3571d9 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:39.159848 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-94399934-7594-4234-a810-08355d3571d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:39.170103 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 602/1207] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 18 19:25:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:39.182403 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94399934-7594-4234-a810-08355d3571d9 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:39.192945 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11e4e7-395e-4431-880e-ebcd22804358 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:39.195042 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94399934-7594-4234-a810-08355d3571d9 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:39.199175 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef62898-adff-4456-9b42-d9ab4671fbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:39.199451 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:39.199961 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62898-adff-4456-9b42-d9ab4671fbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:39.200247 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62898-adff-4456-9b42-d9ab4671fbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:39.200521 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62898-adff-4456-9b42-d9ab4671fbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:39.200764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:39.201275 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:39.201654 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:39.203661 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:39.211901 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62898-adff-4456-9b42-d9ab4671fbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:39.213620 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62898-adff-4456-9b42-d9ab4671fbc1 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:39.217008 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:39.218912 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:39.224618 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 603/1208] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:25:39.229425 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 606/1209] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:48.486045 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf8b3-4016-4cd0-8e77-83b836249fc1 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:48.486598 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf8b3-4016-4cd0-8e77-83b836249fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:48.486697 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf8b3-4016-4cd0-8e77-83b836249fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:48.506323 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-5bedf8b3-4016-4cd0-8e77-83b836249fc1 None None] MFA Rules not processed for user `d18820ebfa644e8585f64355e8bf0f71`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:48.507523 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-5bedf8b3-4016-4cd0-8e77-83b836249fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:48.514437 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 604/1210] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Aug 18 19:25:48 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:48.526752 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:48.536182 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb87822-33a9-4507-9661-3815e4e9496a service placement] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:48.540315 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29060f-2bb1-4d02-af4f-3912052557dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:48.541047 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29060f-2bb1-4d02-af4f-3912052557dc service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:48.541397 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29060f-2bb1-4d02-af4f-3912052557dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:48.541686 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29060f-2bb1-4d02-af4f-3912052557dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:48.550088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29060f-2bb1-4d02-af4f-3912052557dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:48.551648 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29060f-2bb1-4d02-af4f-3912052557dc service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:48.560310 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 607/1211] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:48 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:49.475989 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f09b-1f81-4e8d-8923-4d39dcb4df76 None None] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:49.476313 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f09b-1f81-4e8d-8923-4d39dcb4df76 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:49.476896 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f09b-1f81-4e8d-8923-4d39dcb4df76 None None] PATH_INFO: `/` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:49.478371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 605/1212] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:25:49.510669 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833187-138c-4952-8f92-b391cfeae5ee None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:49.511051 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833187-138c-4952-8f92-b391cfeae5ee None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:49.511584 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833187-138c-4952-8f92-b391cfeae5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:49.531791 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-8a833187-138c-4952-8f92-b391cfeae5ee None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:49.533113 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-8a833187-138c-4952-8f92-b391cfeae5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:49.543725 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 608/1213] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:25:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:25:49.564612 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f09b-1f81-4e8d-8923-4d39dcb4df76 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:49.589021 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f09b-1f81-4e8d-8923-4d39dcb4df76 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:49.595746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c436ab-c7a2-451a-a373-7888eef46a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:49.596362 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c436ab-c7a2-451a-a373-7888eef46a9b service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:49.596653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c436ab-c7a2-451a-a373-7888eef46a9b service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:49.596956 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c436ab-c7a2-451a-a373-7888eef46a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:49.607822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c436ab-c7a2-451a-a373-7888eef46a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:49.610000 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c436ab-c7a2-451a-a373-7888eef46a9b service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:49.620596 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 606/1214] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:25:54.977586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f67d-ae9f-4848-b459-bd7dc5774f76 None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:54.978320 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f67d-ae9f-4848-b459-bd7dc5774f76 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:54.978320 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f67d-ae9f-4848-b459-bd7dc5774f76 None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:54.979527 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 609/1215] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:25:54.988782 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:54.989348 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:54.989348 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:55.013069 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:25:55.014349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:25:55.023758 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 607/1216] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:25:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:25:55.042825 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f67d-ae9f-4848-b459-bd7dc5774f76 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:25:55.059278 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f67d-ae9f-4848-b459-bd7dc5774f76 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:25:55.068182 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001bac8-e47a-4277-aee7-d17bbf1e3cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:25:55.069045 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001bac8-e47a-4277-aee7-d17bbf1e3cdd service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:25:55.069139 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001bac8-e47a-4277-aee7-d17bbf1e3cdd service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:25:55.069414 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001bac8-e47a-4277-aee7-d17bbf1e3cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:25:55.078181 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001bac8-e47a-4277-aee7-d17bbf1e3cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:25:55.080189 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001bac8-e47a-4277-aee7-d17bbf1e3cdd service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:25:55.090568 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 610/1217] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:25:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:26:05.007210 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=28 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:26:05.086579 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=66 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:26:07.425070 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:26:07.434799 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe843593-85c7-4d3e-a8ec-4543e45e3e07 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:26:07.438397 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec07d0-7577-4c3c-9ba9-633fd93df2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:26:07.439046 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec07d0-7577-4c3c-9ba9-633fd93df2aa service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:07.439330 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec07d0-7577-4c3c-9ba9-633fd93df2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:07.439604 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec07d0-7577-4c3c-9ba9-633fd93df2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:07.449325 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec07d0-7577-4c3c-9ba9-633fd93df2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:26:07.450806 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec07d0-7577-4c3c-9ba9-633fd93df2aa service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:26:07.460940 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 608/1218] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:26:07 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:26:09.457418 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f618a-9230-4d1a-b738-0706f1ffe88c None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:09.458337 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f618a-9230-4d1a-b738-0706f1ffe88c None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:09.458685 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f618a-9230-4d1a-b738-0706f1ffe88c None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:09.461896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 611/1219] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:26:09.469123 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947101ba-f5e5-48ed-9599-b5d65fc09177 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:09.469711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947101ba-f5e5-48ed-9599-b5d65fc09177 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:09.469711 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947101ba-f5e5-48ed-9599-b5d65fc09177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:09.504776 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-947101ba-f5e5-48ed-9599-b5d65fc09177 None None] MFA Rules not processed for user `1b3a5ebc5fe740ab818293c3c0b3c31b`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:26:09.506061 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-947101ba-f5e5-48ed-9599-b5d65fc09177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:26:09.516489 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 609/1220] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:26:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:26:09.532774 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f618a-9230-4d1a-b738-0706f1ffe88c None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:26:09.548714 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f618a-9230-4d1a-b738-0706f1ffe88c None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:26:09.554274 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da89f-0d40-4218-ae39-07d39b6c9588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:26:09.555062 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da89f-0d40-4218-ae39-07d39b6c9588 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:09.555443 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da89f-0d40-4218-ae39-07d39b6c9588 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:09.556248 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da89f-0d40-4218-ae39-07d39b6c9588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:09.569223 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0da89f-0d40-4218-ae39-07d39b6c9588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:26:09.571561 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0da89f-0d40-4218-ae39-07d39b6c9588 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:26:09.608958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 612/1221] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:26:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:26:19.498759 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=9 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:26:19.578617 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=6 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:26:28.722673 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33312bc-b7b7-4830-86e0-63877160ac16 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:28.723218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33312bc-b7b7-4830-86e0-63877160ac16 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:28.723218 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33312bc-b7b7-4830-86e0-63877160ac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:28.743271 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-d33312bc-b7b7-4830-86e0-63877160ac16 None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:26:28.744450 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d33312bc-b7b7-4830-86e0-63877160ac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:26:28.751914 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 610/1222] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:26:28 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:26:38.738150 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:26:51.720535 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c92b5-a794-49ff-ab4f-3f4606034039 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:51.721103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c92b5-a794-49ff-ab4f-3f4606034039 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:51.721103 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c92b5-a794-49ff-ab4f-3f4606034039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:51.740289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-663c92b5-a794-49ff-ab4f-3f4606034039 None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:26:51.741455 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-663c92b5-a794-49ff-ab4f-3f4606034039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:26:51.748270 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 613/1223] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:26:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:27:01.735717 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.225332 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0b46-542b-4fd5-a12b-c0e8a2d31966 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.225803 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0b46-542b-4fd5-a12b-c0e8a2d31966 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.225888 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0b46-542b-4fd5-a12b-c0e8a2d31966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.245145 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-a1fa0b46-542b-4fd5-a12b-c0e8a2d31966 None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:05.246364 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-a1fa0b46-542b-4fd5-a12b-c0e8a2d31966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:05.253129 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 611/1224] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:27:05 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:27:15.240498 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:01.603021 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.603456 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.603588 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.622132 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:01.623320 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:01.630436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 614/1225] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:28:01 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:28:01.955789 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.956329 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.956422 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.006252 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] MFA Rules not processed for user `d18820ebfa644e8585f64355e8bf0f71`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:02.007467 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:02.023348 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 612/1226] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 18 19:28:01 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:28:02.034604 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.044938 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44b145-ab39-4598-8b9c-3a17cc66a8ae None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.049667 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.050261 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.050536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.050806 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.057937 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.059359 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.067960 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 615/1227] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:28:12.020091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=17 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:12.064845 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=9 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.496811 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.505594 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac2d6-9e60-4936-a63a-7e92f7bf6444 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.509084 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d4a0c-b2f7-4fc4-93fb-5c8f3f9dc733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.509670 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4a0c-b2f7-4fc4-93fb-5c8f3f9dc733 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.509948 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4a0c-b2f7-4fc4-93fb-5c8f3f9dc733 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.510217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4a0c-b2f7-4fc4-93fb-5c8f3f9dc733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.518772 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4a0c-b2f7-4fc4-93fb-5c8f3f9dc733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.520169 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4a0c-b2f7-4fc4-93fb-5c8f3f9dc733 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.529410 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 613/1228] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:28:23.525289 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=6 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:42.812896 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.825536 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ebad0-fbbb-4925-a338-546c5f5f43fa service neutron] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.830969 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284ca41-f27d-449d-9c33-22c84d2dcb82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.831578 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284ca41-f27d-449d-9c33-22c84d2dcb82 service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.831855 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284ca41-f27d-449d-9c33-22c84d2dcb82 service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.832128 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284ca41-f27d-449d-9c33-22c84d2dcb82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.841384 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284ca41-f27d-449d-9c33-22c84d2dcb82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.842913 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284ca41-f27d-449d-9c33-22c84d2dcb82 service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.853019 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 616/1229] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:28:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:28:52.848729 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=6 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:57.695137 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:57.695640 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:57.695733 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:57.714349 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] MFA Rules not processed for user `b8738a31d47c42b8a01889fcaa9d1fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:57.715548 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:57.722323 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 614/1230] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:29:57 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:30:07.709393 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=3 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:25.064096 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] REQUEST_METHOD: `POST` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:25.064619 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:25.064728 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:25.084266 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.auth.core [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:25.085530 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:25.097075 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 617/1231] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:30:25 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:30:28.379453 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:28.404034 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f2dda-88af-4816-a2a6-4272f750ddea None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:28.410091 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:28.411055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:28.411055 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:28.411482 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:28.421763 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:28.423707 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:28.432973 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 615/1232] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:30:28 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:30:35.079297 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=3 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:38.428850 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=10 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:52.402620 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:52.415831 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16cb5d-4693-438b-b0af-5c688ebd4cf5 None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:52.420639 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:52.421289 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:52.421565 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:52.421833 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:52.430119 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:52.431693 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:52.440177 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 618/1233] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:30:52 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:30:52.594849 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:52.596712 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:52.604625 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b813ff-b2ee-41bf-9ca3-005a2e6b9ffb service nova] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:52.606576 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a734e5-877b-42a8-a91d-5be047af3457 service nova] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:52.608191 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:52.608816 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:52.609097 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:52.609371 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:52.610208 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:52.610784 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:52.611066 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:52.611336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:52.619524 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:52.619676 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:52.621031 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:52.621144 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:52.628987 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 619/1234] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:30:52 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:30:52.631277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 616/1235] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:30:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:30:53.825117 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:53.833352 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527191-66c4-44e5-8010-cb13442655a8 service neutron] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.836915 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.837501 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.837776 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.838044 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.848127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:53.850093 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:53.861870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 620/1236] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:31:02.626880 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=6 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:03.856154 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=18 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:42.718530 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:42.734651 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371fc3-e760-44e5-b9b0-16da4901f483 service neutron] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:42.741252 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:42.741866 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:42.742150 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:42.742432 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:42.751994 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:42.753653 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:42.765746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 617/1237] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:31:42 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:31:48.759525 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:48.770125 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0daa6f-dda1-42ae-bcc1-125a2b1cd9c0 service neutron] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:48.775263 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283885-0f79-4429-93b8-d53b0bf6ea5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:48.776031 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283885-0f79-4429-93b8-d53b0bf6ea5f service nova] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:48.776369 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283885-0f79-4429-93b8-d53b0bf6ea5f service nova] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:48.776749 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283885-0f79-4429-93b8-d53b0bf6ea5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:48.785837 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283885-0f79-4429-93b8-d53b0bf6ea5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:48.787439 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283885-0f79-4429-93b8-d53b0bf6ea5f service nova] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:48.797082 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 621/1238] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:31:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:31:50.424195 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:50.433330 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d071be-0d04-4da9-ab3f-371383c58a10 service nova] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:50.436955 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddd8ab-95bc-4097-8bca-69f186da54e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:50.437551 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddd8ab-95bc-4097-8bca-69f186da54e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:50.437831 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddd8ab-95bc-4097-8bca-69f186da54e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:50.438104 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddd8ab-95bc-4097-8bca-69f186da54e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:50.497738 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddd8ab-95bc-4097-8bca-69f186da54e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:50.499161 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddd8ab-95bc-4097-8bca-69f186da54e8 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:50.516970 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 618/1239] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:31:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:31:53.692424 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745520bf-ea79-4425-8f22-50038772cabe None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:53.692995 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745520bf-ea79-4425-8f22-50038772cabe None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:53.693107 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745520bf-ea79-4425-8f22-50038772cabe None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:53.694593 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 622/1240] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:31:53.719262 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3412c6-f014-4e92-bde5-62bcdec228e9 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:53.719690 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3412c6-f014-4e92-bde5-62bcdec228e9 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:53.720037 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3412c6-f014-4e92-bde5-62bcdec228e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:53.773952 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-7d3412c6-f014-4e92-bde5-62bcdec228e9 None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:53.775206 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-7d3412c6-f014-4e92-bde5-62bcdec228e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:53.795261 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 619/1241] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:31:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:31:53.822562 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86f2a-fba2-4016-86c9-e423c0aab26e None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:53.822856 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86f2a-fba2-4016-86c9-e423c0aab26e None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:53.823139 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86f2a-fba2-4016-86c9-e423c0aab26e None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:53.824454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 623/1242] 10.222.0.46 () {54 vars in 961 bytes} [Thu Aug 18 19:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:31:53.829541 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:53.829903 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:53.830259 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:53.849746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:53.850950 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:53.867171 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 620/1243] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Aug 18 19:31:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:31:53.869075 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86f2a-fba2-4016-86c9-e423c0aab26e None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:53.883569 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86f2a-fba2-4016-86c9-e423c0aab26e None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:53.888435 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:53.889068 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:53.889353 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:53.889628 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:53.897999 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:53.899585 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:53.909336 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 624/1244] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:31:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:31:56.861239 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:56.875023 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23fa68-badc-4de3-ba4b-4e1dd27dab3a None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:56.879912 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:56.880747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:56.881152 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:56.881483 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] PATH_INFO: `/v3/users/b8738a31d47c42b8a01889fcaa9d1fb6` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:56.882742 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8738a31d47c42b8a01889fcaa9d1fb6)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:56.884764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: WARNING py.warnings [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:31:56.884764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: warnings.warn(msg) Aug 18 19:31:56.884764 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: Aug 18 19:31:56.886126 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:56.951109 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8738a31d47c42b8a01889fcaa9d1fb6'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:56.951784 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8738a31d47c42b8a01889fcaa9d1fb6'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:56.974649 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8738a31d47c42b8a01889fcaa9d1fb6'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:56.985683 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8738a31d47c42b8a01889fcaa9d1fb6'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:56.994964 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8738a31d47c42b8a01889fcaa9d1fb6'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:56.996554 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:57.003263 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 621/1245] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 18 19:31:56 2022] DELETE /identity/v3/users/b8738a31d47c42b8a01889fcaa9d1fb6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:31:57.180826 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:57.194884 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaadc5-1480-4c46-ba53-38fe9b5b9d8a service placement] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:57.252524 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:57.253182 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:57.253460 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:57.253761 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] PATH_INFO: `/v3/projects/289f5aca1490482d879439ef3e708487` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:57.254870 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=289f5aca1490482d879439ef3e708487)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:57.255884 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: WARNING py.warnings [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:31:57.255884 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: warnings.warn(msg) Aug 18 19:31:57.255884 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: Aug 18 19:31:57.257127 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:57.310777 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289f5aca1490482d879439ef3e708487', 'request_id': 'req-531adcda-dfed-4755-87a4-f5597488df35'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.317723 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289f5aca1490482d879439ef3e708487', 'request_id': 'req-531adcda-dfed-4755-87a4-f5597488df35'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.325400 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289f5aca1490482d879439ef3e708487', 'request_id': 'req-531adcda-dfed-4755-87a4-f5597488df35'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.343698 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] The token cache is being invalidate because project 289f5aca1490482d879439ef3e708487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:31:57.343989 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.344629 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.346156 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 625/1246] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 18 19:31:57 2022] DELETE /identity/v3/projects/289f5aca1490482d879439ef3e708487 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:31:57.350312 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:57.351704 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:57.365337 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2236-46b8-4583-95c0-0fa657c462b4 admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:57.431154 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:57.431944 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:57.432148 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:57.432426 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] PATH_INFO: `/v3/users/216d669d321e46ec939869d6e07f616f` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:57.433630 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=216d669d321e46ec939869d6e07f616f)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:57.435746 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:57.484277 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216d669d321e46ec939869d6e07f616f'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.484837 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216d669d321e46ec939869d6e07f616f'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.496714 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216d669d321e46ec939869d6e07f616f'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.503407 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216d669d321e46ec939869d6e07f616f'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.511575 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-10125389-1b5a-476b-97d7-d6446c1544a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216d669d321e46ec939869d6e07f616f'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.517890 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 622/1247] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 18 19:31:57 2022] DELETE /identity/v3/users/216d669d321e46ec939869d6e07f616f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:31:57.701589 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:57.703040 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:57.715864 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531adcda-dfed-4755-87a4-f5597488df35 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:57.774819 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:57.779129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:57.779129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:57.779129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] PATH_INFO: `/v3/projects/bdcacc11ff064a84ab2701fcb4b4ce5b` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:57.779129 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcacc11ff064a84ab2701fcb4b4ce5b)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:57.779497 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:57.785556 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:57.826094 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcacc11ff064a84ab2701fcb4b4ce5b', 'request_id': 'req-98c8d511-d78f-481c-b293-8f2a2ac30a7d'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.833059 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcacc11ff064a84ab2701fcb4b4ce5b', 'request_id': 'req-98c8d511-d78f-481c-b293-8f2a2ac30a7d'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.839054 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcacc11ff064a84ab2701fcb4b4ce5b', 'request_id': 'req-98c8d511-d78f-481c-b293-8f2a2ac30a7d'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.849531 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] The token cache is being invalidate because project bdcacc11ff064a84ab2701fcb4b4ce5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:31:57.849816 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.850436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:31:57.852045 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 626/1248] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 18 19:31:57 2022] DELETE /identity/v3/projects/bdcacc11ff064a84ab2701fcb4b4ce5b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:32:07.514386 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:32:07.846638 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:32:21.397454 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:32:21.398019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:32:21.398019 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:32:21.418606 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] MFA Rules not processed for user `f41d113f35574f50997dbcf25fe39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:32:21.420604 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:32:21.482134 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 623/1249] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 18 19:32:21 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:32:22.488593 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:32:22.490302 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:32:22.569829 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8d511-d78f-481c-b293-8f2a2ac30a7d admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:32:22.574764 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:32:22.575373 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:32:22.575657 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:32:22.575933 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:32:22.577697 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:32:22.589513 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:32:22.591136 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:32:22.601135 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 627/1250] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:32:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:32:30.848873 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:32:30.850804 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:32:30.924280 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e89b4-b39c-43f0-9749-d282cbd2ea2b None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:32:30.929643 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3a5ebc5fe740ab818293c3c0b3c31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:32:30.930276 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:32:30.930556 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:32:30.930863 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:32:30.932647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:32:30.944635 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:32:30.946265 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:32:30.957601 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 624/1251] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:32:30 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:32:32.596899 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=32 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:32:40.953305 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=57 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:33:46.798422 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:33:46.799832 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:33:46.859872 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6405c-db9d-4de7-99f3-1f253bd4c1ea service placement] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:33:46.864755 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:33:46.865342 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:33:46.865616 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:33:46.866164 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:33:46.867848 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:33:46.878583 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:33:46.880142 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfdb46-6d7c-442b-a00b-e15122137d1c service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:33:46.889918 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 628/1252] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:33:46 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:33:56.886118 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=28 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:35:10.624188 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:35:10.625622 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:35:10.709029 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37772d3-a6c5-40d8-b21e-78b93b370bcf service nova] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:35:10.712578 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18820ebfa644e8585f64355e8bf0f71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:35:10.713209 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:10.713494 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:10.713771 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:10.715448 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:35:10.797739 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:35:10.799160 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134a836-457f-4a82-97c2-cf2263aabb30 service neutron] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:35:10.808399 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 625/1253] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:35:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:35:13.883203 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30d37-b84d-4356-b00b-ecd7252aaadd None None] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:13.883709 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30d37-b84d-4356-b00b-ecd7252aaadd None None] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:13.883807 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30d37-b84d-4356-b00b-ecd7252aaadd None None] PATH_INFO: `/` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:13.885197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 629/1254] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 18 19:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:35:13.894679 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] REQUEST_METHOD: `POST` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:13.895170 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:13.895366 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:13.927266 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.auth.core [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] MFA Rules not processed for user `51ba6f3c73c64b9ba1b0ab1764a1509d`. Rule list: `[]` (Enabled: `True`). {{(pid=88222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:35:13.928472 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:35:13.938132 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 626/1255] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 18 19:35:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:35:13.951454 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b30d37-b84d-4356-b00b-ecd7252aaadd None None] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:35:13.967034 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b30d37-b84d-4356-b00b-ecd7252aaadd None None] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:35:13.973419 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:35:13.974198 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] REQUEST_METHOD: `GET` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:13.974541 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:13.974881 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:13.984298 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:35:13.986091 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:35:13.997915 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 630/1256] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:35:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:35:17.045300 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:35:17.046843 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:35:17.060024 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd72473-f1cb-4502-baf6-c3f38f266eb5 None None] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:35:17.064456 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:35:17.065121 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:17.065405 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:17.066565 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] PATH_INFO: `/v3/users/f41d113f35574f50997dbcf25fe39f83` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:17.080245 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41d113f35574f50997dbcf25fe39f83)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:35:17.082217 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:35:17.115475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:35:17.129938 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41d113f35574f50997dbcf25fe39f83'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.130580 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41d113f35574f50997dbcf25fe39f83'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.142615 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41d113f35574f50997dbcf25fe39f83'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.149293 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41d113f35574f50997dbcf25fe39f83'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.156306 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41d113f35574f50997dbcf25fe39f83'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.162009 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 627/1257] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 18 19:35:17 2022] DELETE /identity/v3/users/f41d113f35574f50997dbcf25fe39f83 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:35:17.328088 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:35:17.338904 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6bfc5-e190-4484-b397-f7e3ada8ef91 service placement] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:35:17.394952 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:35:17.395586 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:17.395891 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:17.396162 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] PATH_INFO: `/v3/projects/64fd18da9563416ea77e6d354eb1a431` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:17.407197 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fd18da9563416ea77e6d354eb1a431)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:35:17.409816 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:35:17.458936 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fd18da9563416ea77e6d354eb1a431', 'request_id': 'req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.466314 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fd18da9563416ea77e6d354eb1a431', 'request_id': 'req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.471382 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fd18da9563416ea77e6d354eb1a431', 'request_id': 'req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.484762 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] The token cache is being invalidate because project 64fd18da9563416ea77e6d354eb1a431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:35:17.485055 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.485726 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.487515 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 631/1258] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 18 19:35:17 2022] DELETE /identity/v3/projects/64fd18da9563416ea77e6d354eb1a431 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:35:17.491475 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:35:17.493636 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:35:17.507286 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf824-193c-4a5d-83d5-b1ae28880e0b admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:35:17.572526 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:35:17.573200 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:17.573478 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:17.573749 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] PATH_INFO: `/v3/users/cd7dbe8ef0e246eb8ba3140b09878270` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:17.574850 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7dbe8ef0e246eb8ba3140b09878270)` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:35:17.576829 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:35:17.630775 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7dbe8ef0e246eb8ba3140b09878270'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.631444 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7dbe8ef0e246eb8ba3140b09878270'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.643030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7dbe8ef0e246eb8ba3140b09878270'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.649747 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7dbe8ef0e246eb8ba3140b09878270'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.656822 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.notifications [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7dbe8ef0e246eb8ba3140b09878270'} {{(pid=88222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.662702 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 628/1259] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 18 19:35:17 2022] DELETE /identity/v3/users/cd7dbe8ef0e246eb8ba3140b09878270 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:35:17.831779 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Authenticating user token {{(pid=88223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:35:17.833306 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.fernet_utils [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:35:17.848245 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b6db-8e3e-4934-bda1-65f6e54ffe70 admin admin] Validating token access rules against request {{(pid=88223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:35:17.903090 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '661b53358e904910bb42d525c798f725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b376485ea1c4cabaaa338eee652b199', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:35:17.903771 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:35:17.904048 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:35:17.904320 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] PATH_INFO: `/v3/projects/5d17ba38eae64b1c8c217b37c1a67997` {{(pid=88223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:35:17.905958 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d17ba38eae64b1c8c217b37c1a67997)` {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:35:17.907853 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] RBAC: Authorization granted {{(pid=88223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:35:17.917660 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:35:17.954431 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d17ba38eae64b1c8c217b37c1a67997', 'request_id': 'req-1ed316a0-047a-4d0b-9997-7ad30c7023e0'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.961061 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d17ba38eae64b1c8c217b37c1a67997', 'request_id': 'req-1ed316a0-047a-4d0b-9997-7ad30c7023e0'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.966330 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d17ba38eae64b1c8c217b37c1a67997', 'request_id': 'req-1ed316a0-047a-4d0b-9997-7ad30c7023e0'} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.977305 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] The token cache is being invalidate because project 5d17ba38eae64b1c8c217b37c1a67997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:35:17.977591 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.978207 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG keystone.notifications [None req-1ed316a0-047a-4d0b-9997-7ad30c7023e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:35:17.979652 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: [pid: 88223|app: 0|req: 632/1260] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 18 19:35:17 2022] DELETE /identity/v3/projects/5d17ba38eae64b1c8c217b37c1a67997 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:35:27.659299 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=71,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:35:27.974436 dv-osbrick-852610-2-ceph devstack@keystone.service[88223]: DEBUG dbcounter [-] [88223] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:38:50.752914 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Authenticating user token {{(pid=88222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:50.754304 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:50.829586 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7270-9271-4014-a2a5-e401d54918ca admin admin] Validating token access rules against request {{(pid=88222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:50.886345 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ba6f3c73c64b9ba1b0ab1764a1509d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89dd242bc6e48e5a0a73850a2fe5d6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:50.886873 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] REQUEST_METHOD: `GET` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:50.887151 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] SCRIPT_NAME: `/identity` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:50.887421 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:50.889156 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.fernet_utils [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:50.899647 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:50.901250 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21fbf-84ec-4c2d-8dc9-1044649a5cf9 service placement] RBAC: Authorization granted {{(pid=88222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:50.911030 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: [pid: 88222|app: 0|req: 629/1261] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:00.907181 dv-osbrick-852610-2-ceph devstack@keystone.service[88222]: DEBUG dbcounter [-] [88222] Writing DB stats keystone:SELECT=58 {{(pid=88222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}